Sep 28 16:59:20 devstack cinder-volume[75883]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:59:20 devstack cinder-volume[75883]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:59:20 devstack cinder-volume[75883]: we strongly recommend against using it for new projects. Sep 28 16:59:20 devstack cinder-volume[75883]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:59:20 devstack cinder-volume[75883]: framework. For more detail see Sep 28 16:59:20 devstack cinder-volume[75883]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:59:20 devstack cinder-volume[75883]: import eventlet # noqa Sep 28 16:59:23 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:59:23 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:59:23 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:59:24 devstack cinder-volume[75883]: INFO dbcounter [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Registered counter for database cinder Sep 28 16:59:24 devstack cinder-volume[75883]: DEBUG oslo_db.sqlalchemy.engines [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writer thread running {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.rpc [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.rpc [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG oslo_db.sqlalchemy.engines [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Determined volume DB was empty at startup. Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75883) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:59:25 devstack cinder-volume[75883]: WARNING stevedore.named [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:59:25 devstack cinder-volume[75883]: WARNING castellan.key_manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:59:25 devstack cinder-volume[75883]: WARNING cinder.keymgr.conf_key_mgr [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75883) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] CMD "cinder-rtstool verify" returned: 0 in 0.484s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:25 devstack cinder-volume[75883]: DEBUG oslo_db.sqlalchemy.engines [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.rpc [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.rpc [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 16:59:25 devstack cinder-volume[75883]: WARNING stevedore.named [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:59:25 devstack cinder-volume[75883]: WARNING castellan.key_manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:59:25 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_db.sqlalchemy.engines [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:26 devstack cinder-volume[75883]: INFO oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Starting 1 workers Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Started child 76022 {{(pid=75883) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Full set of CONF: {{(pid=75883) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:59:26 devstack cinder-volume[76022]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] ******************************************************************************** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Configuration options gathered from: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] ================================================================================ {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] allow_availability_zone_fallback = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] allow_compression_on_image_upload = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] allowed_direct_url_schemes = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] api_rate_limit = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] auth_strategy = keystone {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] az_cache_duration = 3600 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_availability_zone = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_host = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_stats_polling_interval = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backup_api_class = cinder.backup.api.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backup_name_template = backup-%s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backup_use_same_host = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backup_use_temp_snapshot = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] chap_password = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] chap_username = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_internal_tenant_project_id = 0f6dc8c2d7b0448e97dad04c9cf1f026 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_internal_tenant_user_id = 9abbef5f39a84452a7b6ed5195fbb9e3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cloned_volume_same_az = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cluster = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] compression_format = gzip {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] compute_api_class = cinder.compute.nova.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] config_dir = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] config_source = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] control_exchange = openstack {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] debug = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] default_availability_zone = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] default_group_type = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] default_volume_type = lvmdriver-1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] disk_geometry = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_client_cert = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_client_cert_key = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_data_namespace = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_ssl_cert_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_ssl_cert_verify = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] driver_use_ssl = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] enable_force_upload = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] enable_new_services = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] enable_unsupported_driver = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] enforce_multipath_for_image_xfer = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] filter_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_api_insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_api_ssl_compression = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_ca_certificates_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_catalog_info = image:glance:publicURL {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_num_retries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance_request_timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] goodness_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] graceful_shutdown_timeout = 5 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] group_api_class = cinder.group.api.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] host = devstack {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_compress_on_upload = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_conversion_address_space_limit = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_conversion_cpu_limit = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_conversion_disable = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_introspection_address_space_limit = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_introspection_cpu_limit = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_upload_use_cinder_backend = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_upload_use_internal_tenant = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_volume_cache_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_volume_cache_max_count = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] image_volume_cache_max_size_gb = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] init_host_max_objects_retrieval = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] instance_format = [instance: %(uuid)s] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iscsi_target_flags = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iscsi_write_cache = on {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iser_helper = tgtadm {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iser_ip_address = 192.168.122.140 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iser_port = 3260 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_color = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_config_append = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_dir = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_options = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_rotate_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_rotate_interval_type = days {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] log_rotation_type = none {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] max_age = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] max_logfile_count = 30 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] max_logfile_size_mb = 200 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] max_over_subscription_ratio = 20.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] message_reap_interval = 86400 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] message_ttl = 2592000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] migration_create_volume_timeout_secs = 300 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] monkey_patch = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] monkey_patch_modules = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] my_ip = 192.168.122.140 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] no_snapshot_gb_quota = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] num_iser_scan_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] num_shell_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] num_volume_device_scan_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] nvmeof_conn_info_version = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] nvmet_ns_id = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] nvmet_port_id = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_max_limit = 1000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_ext_list = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_listen_port = 8776 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_use_ssl = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] osapi_volume_workers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] per_volume_size_limit = -1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] periodic_fuzzy_delay = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] periodic_interval = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] public_endpoint = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] publish_errors = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_backup_gigabytes = 1000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_backups = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_gigabytes = 1000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_groups = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_snapshots = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] quota_volumes = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] rate_limit_burst = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] rate_limit_except_level = CRITICAL {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] rate_limit_interval = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] reinit_driver_count = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] replication_device = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] report_discard_supported = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] report_interval = 120 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] reservation_clean_interval = 86400 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] reservation_expire = 86400 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] reserved_image_namespaces = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] reserved_percentage = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] rpc_response_timeout = 120 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] run_external_periodic_tasks = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] scst_target_driver = iscsi {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] scst_target_iqn_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_down_time = 720 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] shell_completion = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] snapshot_name_template = snapshot-%s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] snapshot_same_host = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] split_loggers = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] state_path = /opt/stack/data/cinder {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] storage_availability_zone = nova {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] storage_protocol = iSCSI {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] syslog_log_facility = LOG_USER {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_helper = lioadm {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_ip_address = 192.168.122.140 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_port = 3260 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_protocol = iscsi {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] target_secondary_ip_addresses = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] trace_flags = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] transport_url = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] until_refresh = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_chap_auth = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_default_quota_class = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_journal = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_json = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_multipath_for_image_xfer = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_stderr = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] use_syslog = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] verify_glance_signatures = enabled {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_api_class = cinder.volume.api.API {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_backend_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_clear = zero {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_clear_ionice = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_clear_size = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_copy_bps_limit = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_dd_blocksize = 1M {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_name_template = volume-%s {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_service_inithost_offload = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volume_usage_audit_period = month {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] zoning_mode = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_concurrency.disable_process_locking = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.auth_section = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.auth_type = password {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.auth_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.cache = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.include_service_catalog = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.interface = public {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_password = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcache_username = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.region_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.service_type = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.backend = dogpile.cache.null {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.backend_argument = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.backend_expiration_time = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.config_prefix = cache.oslo {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.debug_cache_backend = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.enable_retry_client = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.enable_socket_keepalive = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.expiration_time = 600 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.hashclient_retry_attempts = 2 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_dead_retry = 300 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_pool_maxsize = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_sasl_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.password = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.proxies = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.redis_db = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.redis_server = localhost:6379 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.retry_attempts = 2 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.retry_delay = 0.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.socket_keepalive_count = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.socket_keepalive_idle = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.socket_keepalive_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.socket_timeout = 1.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.tls_allowed_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.tls_cafile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.tls_certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.tls_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.tls_keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cache.username = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] coordination.backend_url = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.asyncio_connection = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.asyncio_slave_connection = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.backend = sqlalchemy {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.connection = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.connection_debug = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.connection_parameters = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.connection_recycle_time = 3600 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.connection_trace = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.db_inc_retry_interval = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.db_max_retries = 20 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.db_max_retry_interval = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.db_retry_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.max_overflow = 50 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.max_pool_size = 5 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.max_retries = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack sudo[76051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.mysql_wsrep_sync_wait = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.pool_timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.retry_interval = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.slave_connection = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.sqlite_synchronous = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.synchronous_reader = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] database.use_db_reconnect = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_tracing.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.connection_string = messaging:// {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.es_doc_type = notification {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.es_scroll_size = 10000 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.es_scroll_time = 2m {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.filter_error_trace = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.hmac_keys = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.sentinel_service_name = mymaster {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.socket_timeout = 0.1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.trace_requests = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler.trace_sqlalchemy = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler_jaeger.process_tags = {} {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler_jaeger.service_name_prefix = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] profiler_otlp.service_name_prefix = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.enforce_new_defaults = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.policy_default_rule = default {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.policy_file = policy.yaml {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.group = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.helper_command = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] privsep_osbrick.user = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.group = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.helper_command = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] cinder_sys_admin.user = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.auth_section = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.auth_type = password {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.cafile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.collect_timing = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.send_service_user_token = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.split_loggers = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.tls_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] service_user.tls_min_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.auth_section = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.auth_type = password {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.collect_timing = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.region_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.split_loggers = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.tls_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] glance.tls_min_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.backend_availability_zone = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.chap_password = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.chap_username = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.disk_geometry = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_client_cert = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_client_cert_key = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_data_namespace = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.driver_use_ssl = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.extra_capabilities = {} {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.filter_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.goodness_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iscsi_target_flags = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iscsi_write_cache = on {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iser_helper = tgtadm {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iser_port = 3260 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.lvm_share_target = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.lvm_type = auto {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.num_shell_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.replication_device = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.report_discard_supported = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.reserved_percentage = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_helper = tgtadm {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_port = 3260 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_protocol = iscsi {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.trace_flags = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.unique_fqdn_network = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.use_chap_auth = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_backend_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_clear = zero {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_clear_ionice = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_clear_size = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_reports.file_event_handler = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_reports.log_dir = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.backend_host = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.chap_password = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.chap_username = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.disk_geometry = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_client_cert = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.extra_capabilities = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.filter_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.goodness_function = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iser_helper = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iser_ip_address = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iser_port = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.lvm_share_target = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.lvm_type = auto {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.num_shell_tries = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.replication_device = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.report_discard_supported = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.reserved_percentage = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.scst_target_driver = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.storage_protocol = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_helper = lioadm {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_ip_address = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_port = 3260 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.trace_flags = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.use_chap_auth = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_clear = zero {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_clear_size = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] lvmdriver-1.volumes_dir = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_notifications.driver = [] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_notifications.retry = -1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] key_manager.fixed_key = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.barbican_api_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.barbican_endpoint = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.barbican_endpoint_type = public {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.barbican_region_name = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.cafile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.collect_timing = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.number_of_retries = 60 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.retry_delay = 1 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.send_service_user_token = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.split_loggers = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.tls_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.tls_min_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.verify_ssl = True {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican.verify_ssl_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.auth_section = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.auth_type = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.cafile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.certfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.collect_timing = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.insecure = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.keyfile = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.split_loggers = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.timeout = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.tls_ciphers = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] barbican_service_user.tls_min_version = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.approle_role_id = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.approle_secret_id = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.auth_method = approle {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.auth_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.kv_mountpoint = secret {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.kv_path = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.kv_version = 2 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.namespace = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.root_token_id = **** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.ssl_ca_crt_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.timeout = 60.0 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.token_file = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.token_role = None {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.use_ssl = False {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:59:26 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] ******************************************************************************** {{(pid=75883) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:59:26 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack sudo[76152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:26 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:26 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.296s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:59:26 devstack cinder-volume[76022]: INFO cinder.brick.local_dev.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:26 devstack sudo[76260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:26 devstack sudo[76260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:27 devstack sudo[76260]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG cinder.brick.local_dev.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76022) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:27 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:27 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:27 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.532s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:27 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:27 devstack sudo[76551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:27 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:28 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:28 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 16:59:28 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:28 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:28 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:28 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:28 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:28 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:28 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:28 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:28 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:28 devstack sudo[76732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:28 devstack sudo[76732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:29 devstack sudo[76732]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.371s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:29 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:29 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:29 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:29 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:29 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:29 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:29 devstack cinder-volume[76022]: INFO cinder.volume.drivers.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:29 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:29 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:29 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:30 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:30 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:30 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:30 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:30 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:30 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:30 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:30 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:30 devstack sudo[76838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:30 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:31 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:31 devstack sudo[76841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:31 devstack sudo[76841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:31 devstack sudo[76841]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:31 devstack cinder-volume[76022]: INFO cinder.volume.driver [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG cinder.volume.driver [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_db.sqlalchemy.engines [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writer thread running {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG cinder.db.api [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Building query based on filter {{(pid=76022) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG cinder.image.image_utils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:59:31 devstack cinder-volume[76022]: INFO cinder.keymgr.migration [None req-bcf6e373-037a-454e-aed6-09f320c75781 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:31 devstack sudo[76847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:31 devstack sudo[76847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:31 devstack sudo[76847]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:31 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:31 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:31 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:32 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:32 devstack sudo[76853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:32 devstack sudo[76853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:32 devstack sudo[76853]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:32 devstack sudo[76890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:32 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:32 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.507s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:32 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Driver initialization completed successfully. Sep 28 16:59:32 devstack cinder-volume[76022]: INFO cinder.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Initiating service 2 cleanup Sep 28 16:59:32 devstack cinder-volume[76022]: INFO cinder.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Service 2 cleanup completed. Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG cinder.service [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Creating RPC server for service cinder-volume {{(pid=76022) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:59:32 devstack cinder-volume[76022]: DEBUG cinder.service [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76022) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:59:33 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:33 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:33 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:33 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:33 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:33 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:33 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:33 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:33 devstack sudo[76907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:33 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:33 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:34 devstack sudo[76910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:34 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:34 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:34 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:34 devstack cinder-volume[76022]: INFO cinder.volume.manager [None req-e3d1b58c-f461-4d35-a828-893a6c1d0b41 None None] Driver post RPC initialization completed successfully. Sep 28 16:59:36 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=3 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:25 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:25 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack sudo[78698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:25 devstack sudo[78698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:25 devstack sudo[78698]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:25 devstack sudo[78701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:25 devstack sudo[78701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[78701]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:26 devstack sudo[78744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:26 devstack sudo[78744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[78744]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:26 devstack sudo[78747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:26 devstack sudo[78747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:26 devstack sudo[78747]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.334s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:00:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread info: [<_MainThread(MainThread, started 125311522545792)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:01:25 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:25 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:01:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:25 devstack sudo[82003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:01:25 devstack sudo[82003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:25 devstack sudo[82003]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:25 devstack sudo[82006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:01:25 devstack sudo[82006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:26 devstack sudo[82006]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:26 devstack sudo[82009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:01:26 devstack sudo[82009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:26 devstack sudo[82009]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:26 devstack sudo[82012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:01:26 devstack sudo[82012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:26 devstack sudo[82012]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:26 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:01:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:UPDATE=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:25 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:25 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:02:25 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread info: [<_MainThread(MainThread, started 125311522545792)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:25 devstack sudo[84871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:03:25 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:25 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:25 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:03:25 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:25 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:25 devstack sudo[84895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:03:25 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:26 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:26 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:03:26 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:26 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:03:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread info: [<_MainThread(MainThread, started 125311522545792)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:SELECT=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:44 devstack cinder-volume[76022]: DEBUG dbcounter [-] [76022] Writing DB stats cinder:UPDATE=1 {{(pid=76022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG cinder.volume.drivers.lvm [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Updating volume stats {{(pid=76022) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:25 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:04:25 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:25 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:25 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:04:25 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:25 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:25 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:25 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:04:25 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:26 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:26 devstack sudo[85774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:04:26 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:26 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG oslo_concurrency.processutils [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG cinder.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Notifying Schedulers of capabilities ... {{(pid=76022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG oslo_service.periodic_task [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] Running periodic task VolumeManager._thread_info {{(pid=76022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread count: 6 {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:26 devstack cinder-volume[76022]: DEBUG cinder.volume.manager [None req-892e480c-47eb-4d15-84c8-5a6b80189934 None None] thread info: [<_MainThread(MainThread, started 125311522545792)>, , , , , ] {{(pid=76022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:04:32 devstack cinder-volume[75883]: INFO oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Caught SIGTERM, stopping children Sep 28 17:04:32 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Acquiring lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:32 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Acquired lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:32 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Releasing lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:32 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Stop services. {{(pid=75883) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:04:32 devstack cinder-volume[75883]: DEBUG oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Killing children. {{(pid=75883) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:04:32 devstack cinder-volume[75883]: INFO oslo_service.backend._eventlet.service [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Waiting on 1 children to exit Sep 28 17:04:37 devstack cinder-volume[76022]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 17:04:37 devstack cinder-volume[86084]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:04:37 devstack cinder-volume[86084]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:04:37 devstack cinder-volume[86084]: we strongly recommend against using it for new projects. Sep 28 17:04:37 devstack cinder-volume[86084]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:04:37 devstack cinder-volume[86084]: framework. For more detail see Sep 28 17:04:37 devstack cinder-volume[86084]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:04:37 devstack cinder-volume[86084]: import eventlet # noqa Sep 28 17:04:38 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Acquiring lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:38 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Acquired lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:38 devstack cinder-volume[76022]: DEBUG oslo_concurrency.lockutils [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Releasing lock "singleton_lock" {{(pid=76022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:38 devstack cinder-volume[76022]: WARNING amqp [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:04:38 devstack cinder-volume[76022]: WARNING amqp [None req-97973e06-6762-4b56-a576-cf6e74b2ca1d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:04:39 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:39 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:39 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:40 devstack cinder-volume[86084]: INFO dbcounter [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Registered counter for database cinder Sep 28 17:04:40 devstack cinder-volume[86084]: DEBUG oslo_db.sqlalchemy.engines [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:40 devstack cinder-volume[86084]: DEBUG dbcounter [-] [86084] Writer thread running {{(pid=86084) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:04:40 devstack cinder-volume[86084]: INFO cinder.rpc [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:04:40 devstack cinder-volume[86084]: INFO cinder.rpc [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_db.sqlalchemy.engines [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:41 devstack cinder-volume[86084]: INFO cinder.volume.manager [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Determined volume DB was empty at startup. Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG cinder.volume.manager [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86084) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:04:41 devstack cinder-volume[86084]: INFO cinder.volume.manager [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:04:41 devstack cinder-volume[86084]: WARNING stevedore.named [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:04:41 devstack cinder-volume[86084]: WARNING castellan.key_manager [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:04:41 devstack cinder-volume[86084]: WARNING cinder.keymgr.conf_key_mgr [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:04:41 devstack cinder-volume[86084]: INFO cinder.volume.manager [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_db.sqlalchemy.engines [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86084) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:41 devstack cinder-volume[86084]: INFO oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Starting 1 workers Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Started child 86306 {{(pid=86084) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Full set of CONF: {{(pid=86084) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] ******************************************************************************** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Configuration options gathered from: {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] ================================================================================ {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:04:41 devstack cinder-volume[86306]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] allow_availability_zone_fallback = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] allow_compression_on_image_upload = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] allowed_direct_url_schemes = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] api_rate_limit = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] auth_strategy = keystone {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_availability_zone = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_host = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_stats_polling_interval = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backup_api_class = cinder.backup.api.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backup_name_template = backup-%s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backup_use_same_host = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backup_use_temp_snapshot = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] chap_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] chap_username = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_internal_tenant_project_id = 0f6dc8c2d7b0448e97dad04c9cf1f026 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_internal_tenant_user_id = 9abbef5f39a84452a7b6ed5195fbb9e3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cluster = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] compression_format = gzip {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] compute_api_class = cinder.compute.nova.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] config_dir = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] config_source = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] control_exchange = openstack {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] debug = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] default_availability_zone = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] default_group_type = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] default_volume_type = QuobyteHD {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] disk_geometry = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_client_cert = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_client_cert_key = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_data_namespace = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_ssl_cert_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_ssl_cert_verify = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] driver_use_ssl = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] enable_new_services = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] enable_unsupported_driver = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] enabled_backends = ['QuobyteHD'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] enforce_multipath_for_image_xfer = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] filter_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_api_insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_api_ssl_compression = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_ca_certificates_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_catalog_info = image:glance:publicURL {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_num_retries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance_request_timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] goodness_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] graceful_shutdown_timeout = 5 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] group_api_class = cinder.group.api.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] host = devstack {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_compress_on_upload = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_conversion_address_space_limit = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_conversion_cpu_limit = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_conversion_disable = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_introspection_address_space_limit = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_introspection_cpu_limit = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_upload_use_cinder_backend = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_upload_use_internal_tenant = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_volume_cache_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_volume_cache_max_count = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] image_volume_cache_max_size_gb = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] init_host_max_objects_retrieval = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] instance_format = [instance: %(uuid)s] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iscsi_target_flags = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iscsi_write_cache = on {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iser_helper = tgtadm {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iser_ip_address = 192.168.122.140 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iser_port = 3260 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_color = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_config_append = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_dir = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_options = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_rotate_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_rotate_interval_type = days {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] log_rotation_type = none {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] max_age = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] max_logfile_count = 30 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] max_logfile_size_mb = 200 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] max_over_subscription_ratio = 20.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] message_reap_interval = 86400 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] message_ttl = 2592000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] migration_create_volume_timeout_secs = 300 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] monkey_patch = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] monkey_patch_modules = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] my_ip = 192.168.122.140 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] no_snapshot_gb_quota = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] num_iser_scan_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] num_shell_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] num_volume_device_scan_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] nvmeof_conn_info_version = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] nvmet_ns_id = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] nvmet_port_id = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_max_limit = 1000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_ext_list = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_listen_port = 8776 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_use_ssl = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] osapi_volume_workers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] per_volume_size_limit = -1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] periodic_fuzzy_delay = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] periodic_interval = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] public_endpoint = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] publish_errors = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_backup_gigabytes = 1000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_backups = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_gigabytes = 1000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_groups = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_snapshots = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] quota_volumes = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] rate_limit_burst = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] rate_limit_except_level = CRITICAL {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] rate_limit_interval = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] reinit_driver_count = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] replication_device = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] report_discard_supported = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] report_interval = 120 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] reservation_clean_interval = 86400 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] reservation_expire = 86400 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] reserved_image_namespaces = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] reserved_percentage = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] rpc_response_timeout = 120 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] run_external_periodic_tasks = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] scst_target_driver = iscsi {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] scst_target_iqn_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_down_time = 720 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] shell_completion = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] snapshot_name_template = snapshot-%s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] split_loggers = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] state_path = /opt/stack/data/cinder {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] storage_availability_zone = nova {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] storage_protocol = iSCSI {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] syslog_log_facility = LOG_USER {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_helper = lioadm {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_ip_address = 192.168.122.140 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_port = 3260 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_protocol = iscsi {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] target_secondary_ip_addresses = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] trace_flags = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] transport_url = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86306]: INFO cinder.volume.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] until_refresh = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.remotefs [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86306) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_chap_auth = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_default_quota_class = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_journal = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_json = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_multipath_for_image_xfer = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_stderr = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] use_syslog = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] verify_glance_signatures = enabled {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_api_class = cinder.volume.api.API {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_backend_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_clear = zero {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_clear_ionice = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_clear_size = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_copy_bps_limit = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_dd_blocksize = 1M {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_name_template = volume-%s {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_service_inithost_offload = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volume_usage_audit_period = month {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] zoning_mode = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_concurrency.disable_process_locking = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.auth_section = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.auth_type = password {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.auth_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.cache = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.include_service_catalog = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.interface = public {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcache_username = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.region_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.service_type = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.backend = dogpile.cache.null {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.backend_argument = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.backend_expiration_time = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.config_prefix = cache.oslo {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.debug_cache_backend = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.enable_retry_client = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.enable_socket_keepalive = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86306) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.expiration_time = 600 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.hashclient_retry_attempts = 2 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_dead_retry = 300 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: WARNING cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:04:41 devstack cinder-volume[86306]: WARNING cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Running cmd (subprocess): mount.quobyte {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_pool_maxsize = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_sasl_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.proxies = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.redis_db = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.redis_server = localhost:6379 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.retry_attempts = 2 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.retry_delay = 0.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.socket_keepalive_count = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.socket_keepalive_idle = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.socket_keepalive_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.socket_timeout = 1.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.tls_allowed_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.tls_cafile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.tls_certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.tls_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.tls_keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cache.username = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] coordination.backend_url = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.asyncio_connection = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.asyncio_slave_connection = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.backend = sqlalchemy {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.connection = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.connection_debug = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.connection_parameters = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.connection_recycle_time = 3600 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.connection_trace = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.db_inc_retry_interval = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.db_max_retries = 20 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.db_max_retry_interval = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.db_retry_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.max_overflow = 50 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.max_pool_size = 5 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.max_retries = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.mysql_wsrep_sync_wait = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.pool_timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.retry_interval = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.slave_connection = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.sqlite_synchronous = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.synchronous_reader = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] database.use_db_reconnect = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_tracing.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.connection_string = messaging:// {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.es_doc_type = notification {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.es_scroll_size = 10000 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.es_scroll_time = 2m {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.filter_error_trace = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.hmac_keys = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.sentinel_service_name = mymaster {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.socket_timeout = 0.1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.trace_requests = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler.trace_sqlalchemy = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler_jaeger.process_tags = {} {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler_jaeger.service_name_prefix = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] profiler_otlp.service_name_prefix = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.enforce_new_defaults = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.policy_default_rule = default {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.policy_file = policy.yaml {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.group = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.helper_command = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] privsep_osbrick.user = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack quobyte-client[86312]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:04:41 devstack quobyte-client[86312]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.group = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.helper_command = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] cinder_sys_admin.user = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.auth_section = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.auth_type = password {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.cafile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.collect_timing = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.send_service_user_token = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.split_loggers = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86306]: INFO cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e ... Sep 28 17:04:41 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 -c /etc/quobyte/client-cinder.cfg {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.tls_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] service_user.tls_min_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.auth_section = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.auth_type = password {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.collect_timing = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.region_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.split_loggers = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.tls_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] glance.tls_min_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.backend_availability_zone = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.chap_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.chap_username = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.disk_geometry = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_client_cert = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_client_cert_key = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_data_namespace = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.driver_use_ssl = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.extra_capabilities = {} {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.filter_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.goodness_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iscsi_target_flags = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iscsi_write_cache = on {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iser_helper = tgtadm {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 -c /etc/quobyte/client-cinder.cfg Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iser_port = 3260 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_host = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_login = admin {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_mount_options = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_private_key = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_share_path = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.num_shell_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.quobyte_volume_url = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.replication_device = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.report_discard_supported = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.reserved_percentage = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_helper = tgtadm {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_port = 3260 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_protocol = iscsi {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.trace_flags = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.unique_fqdn_network = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.use_chap_auth = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_backend_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_clear = zero {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_clear_ionice = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_clear_size = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_reports.file_event_handler = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_reports.log_dir = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.backend_availability_zone = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.backend_host = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.chap_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.chap_username = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.chiscsi_conf = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.disk_geometry = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_client_cert = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_data_namespace = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.driver_use_ssl = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.extra_capabilities = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.filter_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.goodness_function = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iser_helper = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iser_ip_address = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iser_port = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.iser_target_prefix = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_host = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_login = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_mount_options = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_password = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_private_key = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_share_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_ssh_port = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.num_shell_tries = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.nvmet_port_id = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.replication_device = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.report_discard_supported = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.reserved_percentage = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.scst_target_driver = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.storage_protocol = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_helper = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_ip_address = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_port = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_prefix = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_protocol = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.trace_flags = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.use_chap_auth = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_clear = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_clear_size = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] QuobyteHD.volumes_dir = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_notifications.driver = [] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_notifications.retry = -1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] key_manager.fixed_key = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.barbican_api_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.barbican_endpoint = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.barbican_endpoint_type = public {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.barbican_region_name = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.cafile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.collect_timing = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.number_of_retries = 60 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.retry_delay = 1 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.send_service_user_token = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.split_loggers = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.tls_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.tls_min_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.verify_ssl = True {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican.verify_ssl_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.auth_section = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.auth_type = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.cafile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.certfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.collect_timing = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.insecure = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.keyfile = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.split_loggers = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.timeout = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.tls_ciphers = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] barbican_service_user.tls_min_version = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.approle_role_id = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.approle_secret_id = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.auth_method = approle {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.auth_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.kv_mountpoint = secret {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.kv_path = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.kv_version = 2 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.namespace = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.root_token_id = **** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.ssl_ca_crt_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.timeout = 60.0 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.token_file = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.token_role = None {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.use_ssl = False {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:41 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] ******************************************************************************** {{(pid=86084) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:04:41 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.445s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e succeeded Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.461s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:42 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:42 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:42 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.269s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.volume.driver [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.driver [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1181449890137, 'free_capacity_gb': 1775.1181449890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86306) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_db.sqlalchemy.engines [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86306) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG dbcounter [-] [86306] Writer thread running {{(pid=86306) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.db.api [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Building query based on filter {{(pid=86306) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.image.image_utils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86306) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.keymgr.migration [None req-001f8396-d1b6-4342-a0ee-e2bd1399a952 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:42 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:42 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:42 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.250s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Notifying Schedulers of capabilities ... {{(pid=86306) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.volume.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Driver initialization completed successfully. Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Initiating service 3 cleanup Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Service 3 cleanup completed. Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.service [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Creating RPC server for service cinder-volume {{(pid=86306) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.service [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86306) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:04:42 devstack cinder-volume[86306]: INFO cinder.volume.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86306) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG cinder.volume.drivers.quobyte [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86306) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86306) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:42 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:42 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:42 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:43 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:43 devstack cinder-volume[86306]: DEBUG oslo_concurrency.processutils [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.357s {{(pid=86306) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:43 devstack cinder-volume[86306]: INFO cinder.volume.manager [None req-c53ffd86-5927-4cf6-b6d1-c6b31bc4ed5a None None] Driver post RPC initialization completed successfully. Sep 28 17:04:47 devstack cinder-volume[86306]: DEBUG oslo_service.periodic_task [None req-c884a655-4fab-47a8-99b1-59e3c67e493a None None] Running periodic task VolumeManager._thread_info {{(pid=86306) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:47 devstack cinder-volume[86306]: DEBUG cinder.volume.manager [None req-c884a655-4fab-47a8-99b1-59e3c67e493a None None] thread count: 6 {{(pid=86306) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:47 devstack cinder-volume[86306]: DEBUG cinder.volume.manager [None req-c884a655-4fab-47a8-99b1-59e3c67e493a None None] thread info: [<_MainThread(MainThread, started 126884890206336)>, , , , , ] {{(pid=86306) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:04:47 devstack cinder-volume[86084]: INFO oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Caught SIGTERM, stopping children Sep 28 17:04:47 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Acquiring lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:47 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Acquired lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:47 devstack cinder-volume[86084]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Releasing lock "singleton_lock" {{(pid=86084) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:47 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Stop services. {{(pid=86084) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:04:47 devstack cinder-volume[86084]: DEBUG oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Killing children. {{(pid=86084) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:04:47 devstack cinder-volume[86084]: INFO oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Waiting on 1 children to exit Sep 28 17:04:51 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Acquiring lock "singleton_lock" {{(pid=86306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:51 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Acquired lock "singleton_lock" {{(pid=86306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:51 devstack cinder-volume[86306]: DEBUG oslo_concurrency.lockutils [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Releasing lock "singleton_lock" {{(pid=86306) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:51 devstack cinder-volume[86306]: WARNING amqp [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:04:51 devstack cinder-volume[86306]: WARNING amqp [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:04:51 devstack cinder-volume[86084]: INFO oslo_service.backend._eventlet.service [None req-5d310807-7659-4c36-935c-173b4c41f049 None None] Child 86306 exited with status 0 Sep 28 17:04:52 devstack cinder-volume[86623]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:04:52 devstack cinder-volume[86623]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:04:52 devstack cinder-volume[86623]: we strongly recommend against using it for new projects. Sep 28 17:04:52 devstack cinder-volume[86623]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:04:52 devstack cinder-volume[86623]: framework. For more detail see Sep 28 17:04:52 devstack cinder-volume[86623]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:04:52 devstack cinder-volume[86623]: import eventlet # noqa Sep 28 17:04:55 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:04:55 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:04:55 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:04:56 devstack cinder-volume[86623]: INFO dbcounter [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Registered counter for database cinder Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG dbcounter [-] [86623] Writer thread running {{(pid=86623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:04:56 devstack cinder-volume[86623]: INFO cinder.rpc [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:04:56 devstack cinder-volume[86623]: INFO cinder.rpc [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:56 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Determined volume DB was empty at startup. Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG cinder.volume.manager [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86623) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:04:56 devstack cinder-volume[86623]: WARNING stevedore.named [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:04:56 devstack cinder-volume[86623]: WARNING castellan.key_manager [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:04:56 devstack cinder-volume[86623]: WARNING cinder.keymgr.conf_key_mgr [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:04:56 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:56 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Starting 1 workers Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Started child 86929 {{(pid=86623) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Full set of CONF: {{(pid=86623) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] Configuration options gathered from: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] ================================================================================ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] allow_availability_zone_fallback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] allow_compression_on_image_upload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] allowed_direct_url_schemes = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] api_rate_limit = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] auth_strategy = keystone {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_stats_polling_interval = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backup_api_class = cinder.backup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backup_name_template = backup-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backup_use_same_host = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backup_use_temp_snapshot = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] chap_username = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_internal_tenant_project_id = 0f6dc8c2d7b0448e97dad04c9cf1f026 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_internal_tenant_user_id = 9abbef5f39a84452a7b6ed5195fbb9e3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cluster = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] compression_format = gzip {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] config_dir = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] config_source = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] control_exchange = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] debug = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] default_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] default_group_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86929]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] default_volume_type = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_ssl_cert_verify = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] driver_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] enable_new_services = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] enable_unsupported_driver = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_api_insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_api_servers = ['http://192.168.122.140/image'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_api_ssl_compression = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_ca_certificates_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_num_retries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance_request_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] graceful_shutdown_timeout = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] group_api_class = cinder.group.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] host = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_compress_on_upload = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_conversion_address_space_limit = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_conversion_cpu_limit = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_conversion_disable = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_introspection_address_space_limit = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_introspection_cpu_limit = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_volume_cache_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_volume_cache_max_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] init_host_max_objects_retrieval = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] instance_format = [instance: %(uuid)s] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iscsi_target_flags = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iscsi_write_cache = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iser_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iser_ip_address = 192.168.122.140 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iser_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_color = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_config_append = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_options = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_rotate_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_rotate_interval_type = days {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] log_rotation_type = none {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] max_age = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] max_logfile_count = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] max_logfile_size_mb = 200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] max_over_subscription_ratio = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] message_reap_interval = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] message_ttl = 2592000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] monkey_patch = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] monkey_patch_modules = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] my_ip = 192.168.122.140 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] no_snapshot_gb_quota = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] num_iser_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] num_shell_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] num_volume_device_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] nvmeof_conn_info_version = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] nvmet_ns_id = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] nvmet_port_id = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_max_limit = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_ext_list = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_listen_port = 8776 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] osapi_volume_workers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] per_volume_size_limit = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] periodic_fuzzy_delay = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] periodic_interval = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] public_endpoint = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] publish_errors = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_backup_gigabytes = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_backups = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86929) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_gigabytes = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_groups = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_snapshots = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] quota_volumes = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] rate_limit_burst = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] rate_limit_except_level = CRITICAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] rate_limit_interval = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] reinit_driver_count = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] report_discard_supported = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] report_interval = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] reservation_clean_interval = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] reservation_expire = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] reserved_image_namespaces = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] reserved_percentage = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] rpc_response_timeout = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] run_external_periodic_tasks = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] scst_target_driver = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_down_time = 720 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] shell_completion = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] snapshot_name_template = snapshot-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] state_path = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] storage_availability_zone = nova {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] storage_protocol = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] syslog_log_facility = LOG_USER {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_helper = lioadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_ip_address = 192.168.122.140 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_protocol = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] target_secondary_ip_addresses = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] transport_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] until_refresh = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_chap_auth = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_default_quota_class = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_journal = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_json = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_stderr = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:56 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] use_syslog = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] verify_glance_signatures = enabled {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_api_class = cinder.volume.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_clear = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_clear_size = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_copy_bps_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_dd_blocksize = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_name_template = volume-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_service_inithost_offload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volume_usage_audit_period = month {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] zoning_mode = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.auth_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.interface = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcache_username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.service_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.140/identity {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.backend = dogpile.cache.null {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.backend_argument = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86929) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.backend_expiration_time = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.config_prefix = cache.oslo {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.debug_cache_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.enable_retry_client = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.enable_socket_keepalive = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.expiration_time = 600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_dead_retry = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_sasl_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.proxies = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.redis_db = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.redis_server = localhost:6379 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.retry_attempts = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.retry_delay = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.socket_keepalive_count = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.socket_keepalive_idle = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.socket_keepalive_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.socket_timeout = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.tls_allowed_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.tls_cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.tls_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.tls_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.tls_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Running cmd (subprocess): mount.quobyte {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cache.username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] coordination.backend_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.asyncio_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.asyncio_slave_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.backend = sqlalchemy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.connection_debug = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.connection_parameters = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.connection_recycle_time = 3600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.connection_trace = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.db_inc_retry_interval = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.db_max_retries = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.db_max_retry_interval = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.db_retry_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.max_overflow = 50 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.max_pool_size = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.max_retries = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.pool_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.retry_interval = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.slave_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.sqlite_synchronous = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.synchronous_reader = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] database.use_db_reconnect = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_tracing.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.connection_string = messaging:// {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.es_doc_type = notification {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.es_scroll_size = 10000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.es_scroll_time = 2m {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.filter_error_trace = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.hmac_keys = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.socket_timeout = 0.1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.trace_requests = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler.trace_sqlalchemy = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler_jaeger.process_tags = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] profiler_otlp.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.policy_default_rule = default {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.group = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] privsep_osbrick.user = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.group = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] cinder_sys_admin.user = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.send_service_user_token = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] service_user.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.auth_type = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] glance.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.chap_username = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.driver_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.extra_capabilities = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iscsi_target_flags = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iser_ip_address = 192.168.122.140 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iser_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack quobyte-client[86930]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_host = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_login = admin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_mount_options = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_private_key = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack quobyte-client[86930]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_share_path = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.report_discard_supported = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_ip_address = 192.168.122.140 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_port = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_protocol = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.use_chap_auth = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_clear = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_reports.file_event_handler = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_reports.log_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.backend_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.chap_username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.extra_capabilities = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iser_helper = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iser_ip_address = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iser_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_host = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_login = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_mount_options = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_private_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_share_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.num_shell_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.report_discard_supported = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.reserved_percentage = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.scst_target_driver = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.storage_protocol = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_helper = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_ip_address = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_port = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_protocol = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.trace_flags = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.use_chap_auth = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_clear = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_clear_size = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] QuobyteHD.volumes_dir = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_notifications.driver = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] key_manager.fixed_key = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.barbican_api_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.barbican_endpoint = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.barbican_endpoint_type = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.barbican_region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.number_of_retries = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.retry_delay = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.send_service_user_token = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.verify_ssl = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican.verify_ssl_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.auth_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:57 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] barbican_service_user.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.approle_role_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.approle_secret_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.auth_method = approle {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.auth_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.kv_mountpoint = secret {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.kv_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.kv_version = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.root_token_id = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.ssl_ca_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.timeout = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.token_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.token_role = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:04:57 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-21e83b0c-4778-4800-b3d0-a845dbb54da7 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:04:57 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.346s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[86929]: INFO cinder.volume.driver [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.driver [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1181449890137, 'free_capacity_gb': 1775.1181449890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86929) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_db.sqlalchemy.engines [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86929) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writer thread running {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.db.api [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Building query based on filter {{(pid=86929) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86929) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:57 devstack cinder-volume[86929]: INFO cinder.keymgr.migration [None req-7c8af3d2-22fd-4f3e-869c-94a183a3f7fc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:04:57 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:57 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:57 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.310s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:57 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Driver initialization completed successfully. Sep 28 17:04:58 devstack cinder-volume[86929]: INFO cinder.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Initiating service 3 cleanup Sep 28 17:04:58 devstack cinder-volume[86929]: INFO cinder.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Service 3 cleanup completed. Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG cinder.service [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Creating RPC server for service cinder-volume {{(pid=86929) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG cinder.service [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86929) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:04:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:58 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:04:58 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:58 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.284s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9551b033-73d2-4b7f-a5a7-a02572d67d30 None None] Driver post RPC initialization completed successfully. Sep 28 17:05:06 devstack cinder-volume[86623]: DEBUG dbcounter [-] [86623] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 6 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:05:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:08 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:08 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:07 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:06:07 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:07 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.372s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 6 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Flow 'volume_create_manager' (5cc4854b-af20-4a96-8d76-702bacd44bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656e0e7-1167-4720-a580-8e44a576ba8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7656e0e7-1167-4720-a580-8e44a576ba8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1916997323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9706c1d-c884-40a1-a3bb-65f3192687a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9dc934f7d4a89bcd3f939b59a2a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:11Z,use_quota=True,user_id='01f99d51a2f643b19b99bfba18750f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85507e13-871e-4265-9204-f38a571f25db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85507e13-871e-4265-9204-f38a571f25db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206e761b-3427-4b23-a6fc-c81cebf83c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206e761b-3427-4b23-a6fc-c81cebf83c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9706c1d-c884-40a1-a3bb-65f3192687a1', 'volume_name': 'volume-d9706c1d-c884-40a1-a3bb-65f3192687a1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89dd0f6-bad0-4316-9699-6ac34c23e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c89dd0f6-bad0-4316-9699-6ac34c23e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d1b9d2-059d-46ea-981f-8764b46b725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:11 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Volume d9706c1d-c884-40a1-a3bb-65f3192687a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9706c1d-c884-40a1-a3bb-65f3192687a1', 'volume_size': 1} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1916997323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9706c1d-c884-40a1-a3bb-65f3192687a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9dc934f7d4a89bcd3f939b59a2a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:11Z,use_quota=True,user_id='01f99d51a2f643b19b99bfba18750f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Creating volume d9706c1d-c884-40a1-a3bb-65f3192687a1 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:11 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:06:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:11 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 1073741824 Sep 28 17:06:11 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:12 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 1073741824" returned: 0 in 0.836s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:12 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 Sep 28 17:06:12 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:12 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d1b9d2-059d-46ea-981f-8764b46b725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9706c1d-c884-40a1-a3bb-65f3192687a1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7715a13-a3c8-4376-9ec5-71a5579627bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:12 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Volume volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 (d9706c1d-c884-40a1-a3bb-65f3192687a1): created successfully Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7715a13-a3c8-4376-9ec5-71a5579627bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Flow 'volume_create_manager' (5cc4854b-af20-4a96-8d76-702bacd44bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a79afd35-a42c-4c96-9401-f86e1158e086 tempest-TaggedAttachmentsTest-290342251 None] Created volume successfully. Sep 28 17:06:22 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:22 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:35 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Flow 'volume_create_manager' (2f26f525-3ecd-4c8f-b497-724a2f1a2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3cf3d-bcca-4ae5-85c9-8d280cf0f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3cf3d-bcca-4ae5-85c9-8d280cf0f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1244732833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78dd525-3b95-4a4e-b0ba-8c247d93a1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4722377e547378f7950478a7a6c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:36Z,use_quota=True,user_id='9200a8504fc342889f11dec4f0b904e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0426ec37-f7b9-41ec-84e4-6cb42e476bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0426ec37-f7b9-41ec-84e4-6cb42e476bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57721cf-a571-4e98-bf3e-f808e1780781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c57721cf-a571-4e98-bf3e-f808e1780781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78dd525-3b95-4a4e-b0ba-8c247d93a1b4', 'volume_name': 'volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a8d683-54f1-4064-8b28-2f5da63bf2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a8d683-54f1-4064-8b28-2f5da63bf2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c75793-c9c7-47be-b93c-3425410201b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Volume c78dd525-3b95-4a4e-b0ba-8c247d93a1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4', 'volume_size': 1} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1244732833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78dd525-3b95-4a4e-b0ba-8c247d93a1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca4722377e547378f7950478a7a6c80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:36Z,use_quota=True,user_id='9200a8504fc342889f11dec4f0b904e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Creating volume c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:36 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:06:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 1073741824 Sep 28 17:06:36 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:38 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 1073741824" returned: 0 in 1.863s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:38 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 Sep 28 17:06:38 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:38 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.481s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c75793-c9c7-47be-b93c-3425410201b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e01d2-1c54-4d56-893c-cde37bd76b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:39 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Volume volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 (c78dd525-3b95-4a4e-b0ba-8c247d93a1b4): created successfully Sep 28 17:06:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0e01d2-1c54-4d56-893c-cde37bd76b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Flow 'volume_create_manager' (2f26f525-3ecd-4c8f-b497-724a2f1a2410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f08f8d56-b3be-4f88-a0a9-d2166ecb51be tempest-DeleteServersTestJSON-793742738 None] Created volume successfully. Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Flow 'volume_create_manager' (0502478e-0f5a-47c2-90f9-7c4741354b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebd6832-4f5e-4adb-a56a-11c553eacc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebd6832-4f5e-4adb-a56a-11c553eacc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-698040572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07da8e8-f2f7-4dd9-96a5-e37b800088bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14cda55e95f41e2b209f2a7e75efde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:46Z,use_quota=True,user_id='441a6cb6620f40dbbd5589d5be680e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27572503-758e-4e17-a3cc-9c7ad23f64f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27572503-758e-4e17-a3cc-9c7ad23f64f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a677322e-22fe-4751-8783-a0abd55801f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a677322e-22fe-4751-8783-a0abd55801f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07da8e8-f2f7-4dd9-96a5-e37b800088bf', 'volume_name': 'volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb029c0-a04e-4b1b-8431-584c32f4b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb029c0-a04e-4b1b-8431-584c32f4b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31da21d5-f322-4622-8394-e0563086ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Volume f07da8e8-f2f7-4dd9-96a5-e37b800088bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf', 'volume_size': 1} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-698040572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07da8e8-f2f7-4dd9-96a5-e37b800088bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14cda55e95f41e2b209f2a7e75efde6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:46Z,use_quota=True,user_id='441a6cb6620f40dbbd5589d5be680e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Creating volume f07da8e8-f2f7-4dd9-96a5-e37b800088bf {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:46 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:06:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:46 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf 1073741824 Sep 28 17:06:46 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:47 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf 1073741824" returned: 0 in 0.988s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:47 devstack sudo[88136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf Sep 28 17:06:47 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:49 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" returned: 0 in 1.264s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31da21d5-f322-4622-8394-e0563086ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3f88c-6a63-4450-9738-82b91b6bf6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Volume volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf (f07da8e8-f2f7-4dd9-96a5-e37b800088bf): created successfully Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e3f88c-6a63-4450-9738-82b91b6bf6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Flow 'volume_create_manager' (0502478e-0f5a-47c2-90f9-7c4741354b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7dc4ef5b-e806-408f-989b-3bf57376e881 tempest-VolumesAdminNegativeTest-1752901072 None] Created volume successfully. Sep 28 17:06:49 devstack cinder-volume[86929]: WARNING py.warnings [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:06:49 devstack cinder-volume[86929]: .first() Sep 28 17:06:49 devstack cinder-volume[86929]: Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57195d2a-8fc3-42ea-9523-40c6905bb4ef', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-cdad1eb8-0148-416b-af9f-6cf178c26791 req-1b54d930-5b35-482a-8166-e72487cab10e tempest-DeleteServersTestJSON-793742738 None] attachment_update completed successfully. Sep 28 17:06:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Acquiring lock "cinder-f07da8e8-f2f7-4dd9-96a5-e37b800088bf-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "cinder-f07da8e8-f2f7-4dd9-96a5-e37b800088bf-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Acquiring lock "cinder-quobyte-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "cinder-quobyte-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" acquired by "delete_volume" :: waited 0.071s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:50 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxbzh9j4d/privsep.sock'] Sep 28 17:06:50 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxbzh9j4d/privsep.sock Sep 28 17:06:50 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:06:54 devstack cinder-volume[86929]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:06:54 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:54 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Spawned new privsep daemon via rootwrap Sep 28 17:06:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Accepted privsep connection to /tmp/tmpxbzh9j4d/privsep.sock {{(pid=86929) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:06:54 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:06:54 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:06:54 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:06:54 devstack cinder-volume[86929]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88620 Sep 28 17:06:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65f10f6-8c3b-44de-a45f-bb706e056317]: (2,) {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d9bd10-dc1c-4f40-8756-29402c4ee00c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:55 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf Sep 28 17:06:55 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:56 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" returned: 0 in 1.158s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf Sep 28 17:06:56 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:56 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" returned: 0 in 0.815s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "cinder-quobyte-f07da8e8-f2f7-4dd9-96a5-e37b800088bf" released by "delete_volume" :: held 6.135s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:57 devstack cinder-volume[86929]: WARNING cinder.quota [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:57 devstack cinder-volume[86929]: WARNING cinder.quota [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Created reservations ['462342dd-5356-4be4-b1ef-eef813773a69', '32fb3f8c-a72d-44c1-a33d-2efc9a522286', 'd451458b-aad1-4d1a-abed-28c7ac33ddb0', '26d709b8-24e5-4426-8b4d-71549b537665'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:06:57 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.817s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Deleted volume successfully. Sep 28 17:06:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-18177e26-4e67-466e-8a2c-f9aa195591b6 tempest-VolumesAdminNegativeTest-1752901072 None] Lock "cinder-f07da8e8-f2f7-4dd9-96a5-e37b800088bf-delete_volume" released by "delete_volume" :: held 7.640s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-2f0c0762-1022-44e6-abc2-fd0ca615456c req-e82bb753-6fa8-4c6d-8f55-2095bef0530e tempest-DeleteServersTestJSON-793742738 None] Terminate volume connection completed successfully. Sep 28 17:07:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-2f0c0762-1022-44e6-abc2-fd0ca615456c req-e82bb753-6fa8-4c6d-8f55-2095bef0530e tempest-DeleteServersTestJSON-793742738 None] Deleting attachment 57195d2a-8fc3-42ea-9523-40c6905bb4ef. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "cinder-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "cinder-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "cinder-quobyte-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "cinder-quobyte-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" acquired by "delete_volume" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9db723-eaa5-44f7-858a-e114da970de1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 Sep 28 17:07:05 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:05 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" returned: 0 in 0.529s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:05 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4 Sep 28 17:07:05 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" returned: 0 in 0.405s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "cinder-quobyte-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4" released by "delete_volume" :: held 1.021s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Created reservations ['f4a72dc3-c959-4bfd-8acd-ac02ef59b6bc', '06a466ee-bc79-4aff-bc66-11568b12f731', '1a244f56-345b-4185-b943-2ffcf821f179', 'b48d46dd-4b5f-4c80-96d1-3529c6f36d90'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:06 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:07:06 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:06 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.309s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Deleted volume successfully. Sep 28 17:07:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3c912a66-f822-4855-a7d7-f9de543a3bfb tempest-DeleteServersTestJSON-793742738 None] Lock "cinder-c78dd525-3b95-4a4e-b0ba-8c247d93a1b4-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:07 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:07:07 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 8 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:16 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=23,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:16 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=21,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aa15028a-bc94-46d7-9ab9-e48fcd2f91c4 req-5dea3bdc-dbc8-4e18-9d5c-1d2b693f15cb tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aa15028a-bc94-46d7-9ab9-e48fcd2f91c4 req-5dea3bdc-dbc8-4e18-9d5c-1d2b693f15cb tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aa15028a-bc94-46d7-9ab9-e48fcd2f91c4 req-5dea3bdc-dbc8-4e18-9d5c-1d2b693f15cb tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-aa15028a-bc94-46d7-9ab9-e48fcd2f91c4 req-5dea3bdc-dbc8-4e18-9d5c-1d2b693f15cb tempest-TaggedAttachmentsTest-290342251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-d9706c1d-c884-40a1-a3bb-65f3192687a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66ab60a5-8e39-4fd8-8aab-272c3ec3626a', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:07:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-aa15028a-bc94-46d7-9ab9-e48fcd2f91c4 req-5dea3bdc-dbc8-4e18-9d5c-1d2b693f15cb tempest-TaggedAttachmentsTest-290342251 None] attachment_update completed successfully. Sep 28 17:07:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-b4bc7b99-741c-4f91-a4ce-261020651fa8 req-35b714b1-b6d6-4d54-af8e-245609669449 tempest-TaggedAttachmentsTest-290342251 None] Terminate volume connection completed successfully. Sep 28 17:07:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-b4bc7b99-741c-4f91-a4ce-261020651fa8 req-35b714b1-b6d6-4d54-af8e-245609669449 tempest-TaggedAttachmentsTest-290342251 None] Deleting attachment 66ab60a5-8e39-4fd8-8aab-272c3ec3626a. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:52 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:58 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:08:07 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.610s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 8 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:08:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "cinder-d9706c1d-c884-40a1-a3bb-65f3192687a1-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "cinder-d9706c1d-c884-40a1-a3bb-65f3192687a1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "cinder-quobyte-d9706c1d-c884-40a1-a3bb-65f3192687a1" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "cinder-quobyte-d9706c1d-c884-40a1-a3bb-65f3192687a1" acquired by "delete_volume" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[17520858-9d96-484e-8617-103d2bfbb869]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:21 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 Sep 28 17:08:21 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1" returned: 0 in 0.610s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:22 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1 Sep 28 17:08:22 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:22 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d9706c1d-c884-40a1-a3bb-65f3192687a1" returned: 0 in 0.414s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "cinder-quobyte-d9706c1d-c884-40a1-a3bb-65f3192687a1" released by "delete_volume" :: held 1.171s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:22 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Created reservations ['4f0999ba-c17d-4058-bd44-62d41c29500c', '77594d15-f8e8-4348-9f0d-1e823be4a39b', 'ad8b7aa1-e3eb-4632-bd7f-d0953c533067', 'e2b18764-5c03-455d-87f3-9030fbaabf6f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:23 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:08:23 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:23 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.345s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:23 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Deleted volume successfully. Sep 28 17:08:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-15da8de5-3f23-4345-a885-9d5463d70ddb tempest-TaggedAttachmentsTest-290342251 None] Lock "cinder-d9706c1d-c884-40a1-a3bb-65f3192687a1-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (78efe082-e7a5-4835-b666-de167515e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82259ae5-990b-4cce-b355-dff34b96e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82259ae5-990b-4cce-b355-dff34b96e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1166380906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8818cbe2-e92d-4446-a42c-866f140e9e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:33Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d5f449-7fb1-46c1-b742-04c939e3ad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d5f449-7fb1-46c1-b742-04c939e3ad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2af57-b9c1-44ff-8afe-98049b2cf538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a2af57-b9c1-44ff-8afe-98049b2cf538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8818cbe2-e92d-4446-a42c-866f140e9e7f', 'volume_name': 'volume-8818cbe2-e92d-4446-a42c-866f140e9e7f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023a5f1e-4b5b-4da2-bc76-a45b724fdf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023a5f1e-4b5b-4da2-bc76-a45b724fdf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e4d2a8-a5ba-4db4-9b94-42592403851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Volume 8818cbe2-e92d-4446-a42c-866f140e9e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8818cbe2-e92d-4446-a42c-866f140e9e7f', 'volume_size': 1} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1166380906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8818cbe2-e92d-4446-a42c-866f140e9e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:33Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Creating volume 8818cbe2-e92d-4446-a42c-866f140e9e7f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:33 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:08:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:33 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f 1073741824 Sep 28 17:08:33 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:34 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f 1073741824" returned: 0 in 1.441s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:34 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f Sep 28 17:08:34 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:35 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f" returned: 0 in 0.689s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e4d2a8-a5ba-4db4-9b94-42592403851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8818cbe2-e92d-4446-a42c-866f140e9e7f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04dbb89-9ca2-4be8-abac-fa82a35a3ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Volume volume-8818cbe2-e92d-4446-a42c-866f140e9e7f (8818cbe2-e92d-4446-a42c-866f140e9e7f): created successfully Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04dbb89-9ca2-4be8-abac-fa82a35a3ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (78efe082-e7a5-4835-b666-de167515e84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-88e3c9d3-e220-433f-aab3-8359bbf58519 tempest-AttachVolumeTestJSON-667897622 None] Created volume successfully. Sep 28 17:08:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7520cc6d-990b-4a13-b4aa-5efab1c0321c req-f6ca955c-2e0a-44d7-b20f-1de502883c2f tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7520cc6d-990b-4a13-b4aa-5efab1c0321c req-f6ca955c-2e0a-44d7-b20f-1de502883c2f tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7520cc6d-990b-4a13-b4aa-5efab1c0321c req-f6ca955c-2e0a-44d7-b20f-1de502883c2f tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-7520cc6d-990b-4a13-b4aa-5efab1c0321c req-f6ca955c-2e0a-44d7-b20f-1de502883c2f tempest-AttachVolumeTestJSON-667897622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-8818cbe2-e92d-4446-a42c-866f140e9e7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7eb6d667-ca92-4827-95ee-4e6a41a49a3d', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-7520cc6d-990b-4a13-b4aa-5efab1c0321c req-f6ca955c-2e0a-44d7-b20f-1de502883c2f tempest-AttachVolumeTestJSON-667897622 None] attachment_update completed successfully. Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Flow 'volume_create_manager' (75463eb4-bfa3-4681-b223-68d6d6932401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8acf726-ab6e-4713-8e0c-ea6f845d4010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8acf726-ab6e-4713-8e0c-ea6f845d4010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1412113663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e17b9cd9e2e418c8ea5e987dbc120e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:48Z,use_quota=True,user_id='cfe486d387974f378441d1af6e39d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7819d96-f6d9-4928-8f14-041b529df892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7819d96-f6d9-4928-8f14-041b529df892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cec43d-95eb-4c4d-ad36-5642e9c99aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cec43d-95eb-4c4d-ad36-5642e9c99aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c', 'volume_name': 'volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff48d8d-c46e-4c23-978e-3259cd741c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff48d8d-c46e-4c23-978e-3259cd741c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8891dc2a-f20a-4a15-88eb-589594b3f308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Volume 0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c', 'volume_size': 1} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1412113663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e17b9cd9e2e418c8ea5e987dbc120e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:48Z,use_quota=True,user_id='cfe486d387974f378441d1af6e39d31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Creating volume 0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:48 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:08:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:48 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c 1073741824 Sep 28 17:08:49 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Flow 'volume_create_manager' (e2fd9382-bb3b-40d8-9b54-6246a52a2a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182b74ba-e9a3-4215-87e4-6d712b2616f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182b74ba-e9a3-4215-87e4-6d712b2616f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-821810031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5efa16-8281-4967-a66d-55b51bf416f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66150c5aa044bcad3bb69933db01b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='1a5efb74fb4d49d7b2b49092c1fed8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b96f20-2bd1-407a-ab4e-751c22ee6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b96f20-2bd1-407a-ab4e-751c22ee6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a51ee56-6573-46a9-9ae9-351b7e6706ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a51ee56-6573-46a9-9ae9-351b7e6706ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5efa16-8281-4967-a66d-55b51bf416f4', 'volume_name': 'volume-7c5efa16-8281-4967-a66d-55b51bf416f4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42bb82c-0c15-4b4c-892d-e9ee739738df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42bb82c-0c15-4b4c-892d-e9ee739738df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d660183e-c670-4a3a-8bcc-a750f3866f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Volume 7c5efa16-8281-4967-a66d-55b51bf416f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5efa16-8281-4967-a66d-55b51bf416f4', 'volume_size': 1} Sep 28 17:08:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:50 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c 1073741824" returned: 0 in 1.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:50 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c Sep 28 17:08:50 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" returned: 0 in 0.751s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-821810031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5efa16-8281-4967-a66d-55b51bf416f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66150c5aa044bcad3bb69933db01b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:49Z,use_quota=True,user_id='1a5efb74fb4d49d7b2b49092c1fed8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Creating volume 7c5efa16-8281-4967-a66d-55b51bf416f4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:51 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:51 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 1073741824 Sep 28 17:08:51 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8891dc2a-f20a-4a15-88eb-589594b3f308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac780445-4f21-4eff-a74e-faf6e6bfcc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:51 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Volume volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c (0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c): created successfully Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac780445-4f21-4eff-a74e-faf6e6bfcc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Flow 'volume_create_manager' (75463eb4-bfa3-4681-b223-68d6d6932401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b6b903fc-4435-4928-ac7f-e1fca6b6b2c7 tempest-ServerRescueNegativeTestJSON-1575994927 None] Created volume successfully. Sep 28 17:08:52 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 1073741824" returned: 0 in 1.779s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:53 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 Sep 28 17:08:53 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:53 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4" returned: 0 in 0.556s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] <== create_volume: return (2718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d660183e-c670-4a3a-8bcc-a750f3866f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5efa16-8281-4967-a66d-55b51bf416f4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50da54d-2e90-4617-ad92-b69071b8a5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:53 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Volume volume-7c5efa16-8281-4967-a66d-55b51bf416f4 (7c5efa16-8281-4967-a66d-55b51bf416f4): created successfully Sep 28 17:08:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50da54d-2e90-4617-ad92-b69071b8a5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Flow 'volume_create_manager' (e2fd9382-bb3b-40d8-9b54-6246a52a2a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3df0176f-24c0-4c5a-b0cb-2360cb149ae1 tempest-ServerActionsTestOtherA-1026857971 None] Created volume successfully. Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Flow 'volume_create_manager' (5cf3d228-8ad2-4dd4-8e25-bc3ddc32ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e65dd0-fac5-4da8-a909-bfd21f600041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e65dd0-fac5-4da8-a909-bfd21f600041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-308180652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69721f02-1556-43be-8efb-151865512216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb6cff040f4aafa3d646cc0316e84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:59Z,use_quota=True,user_id='7f0a8607f99d4c9398b8b63ecf69bde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbd7ece-e5c6-407e-8b30-e4fd8318b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bbd7ece-e5c6-407e-8b30-e4fd8318b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c5e1e-b73d-4407-aace-79e7b955f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c5e1e-b73d-4407-aace-79e7b955f995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69721f02-1556-43be-8efb-151865512216', 'volume_name': 'volume-69721f02-1556-43be-8efb-151865512216', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daa9a7d-b9fa-4a43-9970-91f7ca3416c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daa9a7d-b9fa-4a43-9970-91f7ca3416c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea76f04a-deec-47d9-9525-1e69ce9a16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Volume 69721f02-1556-43be-8efb-151865512216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69721f02-1556-43be-8efb-151865512216', 'volume_size': 1} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-308180652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69721f02-1556-43be-8efb-151865512216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0adb6cff040f4aafa3d646cc0316e84a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:59Z,use_quota=True,user_id='7f0a8607f99d4c9398b8b63ecf69bde2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Creating volume 69721f02-1556-43be-8efb-151865512216 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:59 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:08:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:59 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 1073741824 Sep 28 17:08:59 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 1073741824" returned: 0 in 1.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:01 devstack sudo[91210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 Sep 28 17:09:01 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:01 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216" returned: 0 in 0.804s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea76f04a-deec-47d9-9525-1e69ce9a16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69721f02-1556-43be-8efb-151865512216', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca5e44-ead5-4064-9f6e-062eb376fae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:02 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Volume volume-69721f02-1556-43be-8efb-151865512216 (69721f02-1556-43be-8efb-151865512216): created successfully Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daca5e44-ead5-4064-9f6e-062eb376fae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Flow 'volume_create_manager' (5cf3d228-8ad2-4dd4-8e25-bc3ddc32ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-8e1c6088-d6f4-487f-aef1-bfa85dad2703 req-95cedc1f-04f1-4fd4-8f69-6eafcc841064 tempest-VolumesSnapshotsTestJSON-1572613087 None] Created volume successfully. Sep 28 17:09:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Creating offline snapshot 7d1c305a-3a1d-493c-88dd-020770848357 of volume 69721f02-1556-43be-8efb-151865512216 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:09:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aa0227-b2dc-4af0-81eb-3071a8ea0724]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:04 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 Sep 28 17:09:04 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:04 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216" returned: 0 in 1.124s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 1G Sep 28 17:09:05 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 1G" returned: 0 in 1.069s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69721f02-1556-43be-8efb-151865512216 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69721f02-1556-43be-8efb-151865512216 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 Sep 28 17:09:06 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69721f02-1556-43be-8efb-151865512216 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357" returned: 0 in 1.012s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 is being set with open permissions: ugo+rw Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:07 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 Sep 28 17:09:07 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:07 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:07 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357" returned: 0 in 0.764s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:08 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info Sep 28 17:09:08 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:08 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 1.055s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 8 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:08 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info" returned: 0 in 0.788s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:08 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info is being set with open permissions: ugo+rw Sep 28 17:09:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:08 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info Sep 28 17:09:08 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:09 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.info" returned: 0 in 0.721s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.822s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-0a7ba48b-0404-4ddd-8914-94198504a0e4 req-be893681-9c9e-408d-b5a9-a5f3124077ec tempest-VolumesSnapshotsTestJSON-1572613087 None] Create snapshot completed successfully Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "cinder-7d1c305a-3a1d-493c-88dd-020770848357-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-7d1c305a-3a1d-493c-88dd-020770848357-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "cinder-quobyte-7d1c305a-3a1d-493c-88dd-020770848357" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-7d1c305a-3a1d-493c-88dd-020770848357" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Deleting offline snapshot 7d1c305a-3a1d-493c-88dd-020770848357 of volume 69721f02-1556-43be-8efb-151865512216 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] snapshot_file for this snap is: volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[87016e54-c3c6-4059-8210-4f3aa8b6193f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:11 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 Sep 28 17:09:11 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:12 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357" returned: 0 in 1.004s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69721f02-1556-43be-8efb-151865512216(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:09:12 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27cc37e-bc58-45db-a0fc-7f45d9361c69]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:12 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 Sep 28 17:09:12 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:13 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216" returned: 0 in 0.707s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:13 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 Sep 28 17:09:13 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:14 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357" returned: 0 in 1.157s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:14 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357 Sep 28 17:09:14 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:15 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216.7d1c305a-3a1d-493c-88dd-020770848357" returned: 0 in 0.763s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-7d1c305a-3a1d-493c-88dd-020770848357" released by "_delete_snapshot" :: held 3.958s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" released by "delete_snapshot" :: held 4.047s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:15 devstack cinder-volume[86929]: WARNING cinder.quota [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:09:15 devstack cinder-volume[86929]: DEBUG cinder.quota [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Created reservations ['f57bd450-2c87-4351-a97a-274d51531d51', '46cff140-dceb-4948-9dbb-7d9f873a748e', '4466dd2f-212b-4a80-ac30-d080e1f59aec', 'b3b1d111-8ca5-4eab-8ef1-05428596bf0c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:15 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Delete snapshot completed successfully. Sep 28 17:09:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-5722dced-99dc-4a85-a154-0f9000967975 req-45a365e8-8475-4402-879d-f5a00c7a6496 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-7d1c305a-3a1d-493c-88dd-020770848357-delete_snapshot" released by "delete_snapshot" :: held 4.626s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "cinder-69721f02-1556-43be-8efb-151865512216-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-69721f02-1556-43be-8efb-151865512216-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970e05b-1cc1-477d-b9e3-d0a28d4da7d6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 Sep 28 17:09:17 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Acquiring lock "cinder-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "cinder-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Acquiring lock "cinder-quobyte-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "cinder-quobyte-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" acquired by "delete_volume" :: waited 0.127s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:17 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216" returned: 0 in 0.658s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf870167-6773-47cc-b7e0-01a4d2c8b2be]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:17 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216 Sep 28 17:09:17 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c Sep 28 17:09:17 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:18 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-69721f02-1556-43be-8efb-151865512216" returned: 0 in 0.729s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-quobyte-69721f02-1556-43be-8efb-151865512216" released by "delete_volume" :: held 1.549s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG cinder.quota [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Created reservations ['0923496e-d7ad-4b1c-8284-cd2ab0cc55b4', 'd66f776b-ff42-428f-b9be-48d3303f9ed8', 'a7e11282-0e53-439b-b961-ea5a396b1267', 'cfac21aa-d4c3-4d77-944f-5d4499d0df52'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:18 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" returned: 0 in 1.121s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:18 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c Sep 28 17:09:18 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:18 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:18 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:19 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" returned: 0 in 0.600s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.590s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG cinder.manager [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "cinder-quobyte-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c" released by "delete_volume" :: held 1.877s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Deleted volume successfully. Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-800775e7-ec53-461f-8462-6b1ff8de190c req-42e5b731-8e48-4074-b42d-e171619dbb59 tempest-VolumesSnapshotsTestJSON-1572613087 None] Lock "cinder-69721f02-1556-43be-8efb-151865512216-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:19 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Created reservations ['8f6c35ad-03b2-447e-903f-b452c96d49a2', 'daafa691-c9a5-44bf-a1c8-3bddc8f0bb8a', '3c720fae-0107-412b-8a95-6312abc80014', 'c980c056-0d0b-41f1-95d0-b6f3f2607d40'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:20 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.705s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Deleted volume successfully. Sep 28 17:09:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c73e6994-7f16-45d4-8a6d-a8e2f60eb4f8 tempest-ServerRescueNegativeTestJSON-1575994927 None] Lock "cinder-0bcf5c8b-9e1d-4354-bdaf-5f62cfab542c-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Flow 'volume_create_manager' (05f4f01f-2745-4c3c-9587-316c1e3cf537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d085df-5794-4ae6-9386-33a7631aeed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d085df-5794-4ae6-9386-33a7631aeed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1869445035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc56d19-97e2-4b7b-91f3-1f1c67d32f89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4288efe416c949cc9aac1de8f2cf2d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='2d654b263c764f57a550387a05e30d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c87257-d922-4171-a6dd-4326917ffe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c87257-d922-4171-a6dd-4326917ffe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae96fcb-2baf-4e6e-bd03-a716092194e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae96fcb-2baf-4e6e-bd03-a716092194e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc56d19-97e2-4b7b-91f3-1f1c67d32f89', 'volume_name': 'volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a94b77-42f1-4b4d-b415-d6266beab114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a94b77-42f1-4b4d-b415-d6266beab114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf9fed7-692a-4722-ac8a-2eb52dd589e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Volume 2bc56d19-97e2-4b7b-91f3-1f1c67d32f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89', 'volume_size': 1} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1869445035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc56d19-97e2-4b7b-91f3-1f1c67d32f89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4288efe416c949cc9aac1de8f2cf2d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:29Z,use_quota=True,user_id='2d654b263c764f57a550387a05e30d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Creating volume 2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:29 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:09:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:29 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 1073741824 Sep 28 17:09:29 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 1073741824" returned: 0 in 0.819s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:30 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 Sep 28 17:09:30 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:30 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" returned: 0 in 0.393s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf9fed7-692a-4722-ac8a-2eb52dd589e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbc7b62-398d-47c5-8671-503277fe599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:30 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Volume volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 (2bc56d19-97e2-4b7b-91f3-1f1c67d32f89): created successfully Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbc7b62-398d-47c5-8671-503277fe599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Flow 'volume_create_manager' (05f4f01f-2745-4c3c-9587-316c1e3cf537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-cfe341ab-7db1-4424-9ce5-a70fe66c1821 req-8532dd75-b106-43fd-985e-44c3ca8d5ef3 tempest-VolumesGetTestJSON-1526487202 None] Created volume successfully. Sep 28 17:09:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Acquiring lock "cinder-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "cinder-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Acquiring lock "cinder-quobyte-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "cinder-quobyte-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f70a41f-7341-4160-a09d-c52432a1f29f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 Sep 28 17:09:32 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" returned: 0 in 0.423s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:32 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89 Sep 28 17:09:32 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:32 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "cinder-quobyte-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89" released by "delete_volume" :: held 0.787s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:32 devstack cinder-volume[86929]: DEBUG cinder.quota [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Created reservations ['f12a8cf8-a39e-46e7-9373-853d5d82947e', '7443889e-e5c2-4de9-b666-279409101d7b', 'f63afca7-acb2-4d8b-b2b3-c6886dedc953', 'ca5cc700-6553-4bc5-bdb4-840db1c4a3c9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:33 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:33 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:33 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.348s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG cinder.manager [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Deleted volume successfully. Sep 28 17:09:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-986bc250-27e7-4b77-b14f-aa6abf491735 req-53eacbaf-b99d-4f6b-9b39-0f0ee25a9fb4 tempest-VolumesGetTestJSON-1526487202 None] Lock "cinder-2bc56d19-97e2-4b7b-91f3-1f1c67d32f89-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-d969b442-d4c6-401d-a18f-0bb55e100109 req-bd2f4da5-103b-4489-89a4-30c9c0f9d516 tempest-AttachVolumeTestJSON-667897622 None] Terminate volume connection completed successfully. Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-d969b442-d4c6-401d-a18f-0bb55e100109 req-bd2f4da5-103b-4489-89a4-30c9c0f9d516 tempest-AttachVolumeTestJSON-667897622 None] Deleting attachment 7eb6d667-ca92-4827-95ee-4e6a41a49a3d. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (1b9cd4eb-343e-4b12-b55c-af996d87c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcae653-a45b-4fcc-b0ae-6487de5c4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcae653-a45b-4fcc-b0ae-6487de5c4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1288263909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b545d38-abb2-4fb9-8767-7ba1b80a9593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:39Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3638b41a-fc7d-451a-8d9e-42bbcdffe6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3638b41a-fc7d-451a-8d9e-42bbcdffe6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61447944-05f4-4fc6-894c-5811e2f6efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61447944-05f4-4fc6-894c-5811e2f6efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b545d38-abb2-4fb9-8767-7ba1b80a9593', 'volume_name': 'volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ef17a-7a79-4eb4-bfd1-1ad05b2e84d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ef17a-7a79-4eb4-bfd1-1ad05b2e84d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13a533c-47ea-4f91-bcf9-3b098cd81785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:38 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Volume 3b545d38-abb2-4fb9-8767-7ba1b80a9593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593', 'volume_size': 1} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1288263909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b545d38-abb2-4fb9-8767-7ba1b80a9593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:39Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Creating volume 3b545d38-abb2-4fb9-8767-7ba1b80a9593 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:38 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:09:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:39 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 1073741824 Sep 28 17:09:39 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:39 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 1073741824" returned: 0 in 0.770s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:39 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 Sep 28 17:09:39 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:40 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13a533c-47ea-4f91-bcf9-3b098cd81785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a4d8ee-25e3-487e-a01e-2d3ea854ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Volume volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 (3b545d38-abb2-4fb9-8767-7ba1b80a9593): created successfully Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a4d8ee-25e3-487e-a01e-2d3ea854ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (1b9cd4eb-343e-4b12-b55c-af996d87c26f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9903470a-412f-427e-8600-e74375023374 tempest-VolumesTestJSON-536827687 None] Created volume successfully. Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (47cab9fd-8583-452c-9d6a-fd313db7d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b239b-1a21-41af-b1f4-129954f7dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55b239b-1a21-41af-b1f4-129954f7dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1983627285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a70fd-1cbb-48c7-9ffb-63e139d3af0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:42Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b092078a-d0d2-42a4-a792-5f4db20a40cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b092078a-d0d2-42a4-a792-5f4db20a40cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b7af39-b51a-432e-b7e3-dcde66a2c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b7af39-b51a-432e-b7e3-dcde66a2c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51a70fd-1cbb-48c7-9ffb-63e139d3af0b', 'volume_name': 'volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aced9229-f5ac-4d8a-9368-5bf6f6c28b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aced9229-f5ac-4d8a-9368-5bf6f6c28b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2caf9b-9abb-44a6-b59c-d73e27677328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Volume c51a70fd-1cbb-48c7-9ffb-63e139d3af0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b', 'volume_size': 1} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1983627285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a70fd-1cbb-48c7-9ffb-63e139d3af0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:42Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Creating volume c51a70fd-1cbb-48c7-9ffb-63e139d3af0b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:09:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:42 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b 1073741824 Sep 28 17:09:42 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:43 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b 1073741824" returned: 0 in 1.186s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:43 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b Sep 28 17:09:43 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:43 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" returned: 0 in 0.359s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2caf9b-9abb-44a6-b59c-d73e27677328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf7f1a9-06dc-4cc0-ac30-ab6456a45d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Volume volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b (c51a70fd-1cbb-48c7-9ffb-63e139d3af0b): created successfully Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf7f1a9-06dc-4cc0-ac30-ab6456a45d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (47cab9fd-8583-452c-9d6a-fd313db7d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b95764e2-85df-482f-82cf-348163a9cb43 tempest-VolumesTestJSON-536827687 None] Created volume successfully. Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (03e606ad-a2cd-43db-8bda-114dd29107ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff68fe99-b7fa-4074-b171-b5d67055c1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff68fe99-b7fa-4074-b171-b5d67055c1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1269633971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f255bc86-1c07-4c2d-92cb-db3565a6a678,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:45Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa43c32a-40d8-4cf7-8f1d-195ab74f9946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa43c32a-40d8-4cf7-8f1d-195ab74f9946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754d6e55-1699-4b83-a8e9-9237167c298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (754d6e55-1699-4b83-a8e9-9237167c298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f255bc86-1c07-4c2d-92cb-db3565a6a678', 'volume_name': 'volume-f255bc86-1c07-4c2d-92cb-db3565a6a678', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05929857-b822-4e5e-8d4e-d081f25ee79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05929857-b822-4e5e-8d4e-d081f25ee79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eda483-a45d-4c2e-abcd-86fb715df182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Volume f255bc86-1c07-4c2d-92cb-db3565a6a678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f255bc86-1c07-4c2d-92cb-db3565a6a678', 'volume_size': 1} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1269633971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f255bc86-1c07-4c2d-92cb-db3565a6a678,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55cc30d9b08443428f750d77d2c4ac73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:45Z,use_quota=True,user_id='94bea912455e49aa9ebbd538f3d297c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Creating volume f255bc86-1c07-4c2d-92cb-db3565a6a678 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:45 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:09:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:45 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 1073741824 Sep 28 17:09:45 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 1073741824" returned: 0 in 0.754s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 Sep 28 17:09:46 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678" returned: 0 in 0.518s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eda483-a45d-4c2e-abcd-86fb715df182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f255bc86-1c07-4c2d-92cb-db3565a6a678', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ca78b9-8674-4bc5-9b9f-de3c6079d2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Volume volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 (f255bc86-1c07-4c2d-92cb-db3565a6a678): created successfully Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ca78b9-8674-4bc5-9b9f-de3c6079d2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Flow 'volume_create_manager' (03e606ad-a2cd-43db-8bda-114dd29107ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-38131870-0c96-40fa-991b-ef0c7a7a540b tempest-VolumesTestJSON-536827687 None] Created volume successfully. Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=41,cinder:UPDATE=50,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=55,cinder:SELECT=40,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-340b5747-10c0-417b-bcf3-fb2150936590 req-4f53ac0d-0194-4df1-8f71-8418adbd008d tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-340b5747-10c0-417b-bcf3-fb2150936590 req-4f53ac0d-0194-4df1-8f71-8418adbd008d tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-340b5747-10c0-417b-bcf3-fb2150936590 req-4f53ac0d-0194-4df1-8f71-8418adbd008d tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-340b5747-10c0-417b-bcf3-fb2150936590 req-4f53ac0d-0194-4df1-8f71-8418adbd008d tempest-ServerActionsTestOtherA-1026857971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-7c5efa16-8281-4967-a66d-55b51bf416f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22140e42-161a-45b8-a2d2-7992dac3798a', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-340b5747-10c0-417b-bcf3-fb2150936590 req-4f53ac0d-0194-4df1-8f71-8418adbd008d tempest-ServerActionsTestOtherA-1026857971 None] attachment_update completed successfully. Sep 28 17:09:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-f255bc86-1c07-4c2d-92cb-db3565a6a678-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "cinder-f255bc86-1c07-4c2d-92cb-db3565a6a678-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-quobyte-f255bc86-1c07-4c2d-92cb-db3565a6a678" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-f255bc86-1c07-4c2d-92cb-db3565a6a678" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541171a-2472-4c0b-854c-ca9d2c73f3f1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 Sep 28 17:09:50 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:50 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678" returned: 0 in 0.905s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:50 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678 Sep 28 17:09:50 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:51 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f255bc86-1c07-4c2d-92cb-db3565a6a678" returned: 0 in 0.488s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-f255bc86-1c07-4c2d-92cb-db3565a6a678" released by "delete_volume" :: held 1.528s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Created reservations ['b11bb3e4-31ed-4552-96f5-e89e4e127597', '142c7f78-32ec-4ab8-bd84-ec0ccecdc196', '7a444427-7c8f-4335-a57c-78c06247a34d', '3fb0d524-70a3-488c-b98b-75f71ae78fda'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:51 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:51 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:52 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.408s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Deleted volume successfully. Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-60cc0224-2e35-4911-a605-3aadd111dfe0 tempest-VolumesTestJSON-536827687 None] Lock "cinder-f255bc86-1c07-4c2d-92cb-db3565a6a678-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "cinder-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-quobyte-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ce8f5-d835-4eaa-93e9-6330f2f2f818]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:52 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b Sep 28 17:09:52 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:52 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" returned: 0 in 0.457s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b Sep 28 17:09:53 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:53 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" returned: 0 in 0.514s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b" released by "delete_volume" :: held 1.056s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Created reservations ['a940912e-b4df-4806-8f89-d7af8be451f4', '45bfeffb-f506-449c-bfc3-6dc6fd9cc311', '60d52966-b94a-4150-afec-10609fcd6b35', '5d658fee-030c-4c74-b278-7a6221fc099c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:53 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:53 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:54 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Deleted volume successfully. Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ccfedae3-16f1-4723-9a5f-e0da2a34cc48 tempest-VolumesTestJSON-536827687 None] Lock "cinder-c51a70fd-1cbb-48c7-9ffb-63e139d3af0b-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-3b545d38-abb2-4fb9-8767-7ba1b80a9593-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "cinder-3b545d38-abb2-4fb9-8767-7ba1b80a9593-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Acquiring lock "cinder-quobyte-3b545d38-abb2-4fb9-8767-7ba1b80a9593" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-3b545d38-abb2-4fb9-8767-7ba1b80a9593" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34af07c-6b29-478c-b758-5e0ab1de49dd]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-7b1a66b9-210c-4339-bc2d-967ce8316b35 tempest-ServerActionsTestOtherA-1026857971 None] Terminate volume connection completed successfully. Sep 28 17:09:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-7b1a66b9-210c-4339-bc2d-967ce8316b35 tempest-ServerActionsTestOtherA-1026857971 None] Deleting attachment 22140e42-161a-45b8-a2d2-7992dac3798a. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:55 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 Sep 28 17:09:55 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:55 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593" returned: 0 in 0.814s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:55 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593 Sep 28 17:09:55 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:56 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b545d38-abb2-4fb9-8767-7ba1b80a9593" returned: 0 in 0.628s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "cinder-quobyte-3b545d38-abb2-4fb9-8767-7ba1b80a9593" released by "delete_volume" :: held 1.542s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Created reservations ['92eadd39-26ff-497e-924e-5af1bc6a48f0', '45e972a1-b7c9-42e2-927d-552b07302c08', 'ce74e532-fb08-47db-ac2a-912a5c5002e9', '7392d636-3201-47b7-a20e-30d94aaa8c34'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:56 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:09:56 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-954560ee-3403-4759-88ca-6e5249877f60 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-954560ee-3403-4759-88ca-6e5249877f60 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-954560ee-3403-4759-88ca-6e5249877f60 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-954560ee-3403-4759-88ca-6e5249877f60 tempest-ServerActionsTestOtherA-1026857971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-7c5efa16-8281-4967-a66d-55b51bf416f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b2741da-0ffa-4329-a011-98debb5c8338', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-a766668e-11e1-4583-ac7b-3860bb16ccc6 req-954560ee-3403-4759-88ca-6e5249877f60 tempest-ServerActionsTestOtherA-1026857971 None] attachment_update completed successfully. Sep 28 17:09:57 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.850s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:57 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Deleted volume successfully. Sep 28 17:09:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abc0233e-8b3d-4805-9bf8-bd3b69961df3 tempest-VolumesTestJSON-536827687 None] Lock "cinder-3b545d38-abb2-4fb9-8767-7ba1b80a9593-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:07 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:10:07 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:07 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=27,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:08 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.605s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 8 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a0b10bed-0850-4db1-aaef-412ba83d7cbf tempest-BackendsCapabilitiesAdminTestsJSON-17307405 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1181449890137, 'free_capacity_gb': 1775.1181449890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86929) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:10:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d68551b3-1ad0-47aa-897e-38723806a6c9 tempest-BackendsCapabilitiesAdminTestsJSON-17307405 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1181449890137, 'free_capacity_gb': 1775.1181449890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86929) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:10:46 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Flow 'volume_create_manager' (c19b62c3-904d-45af-84e5-1d7b7f586077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab198d3d-3d35-402c-bdb3-d862f2a4cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab198d3d-3d35-402c-bdb3-d862f2a4cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-522297766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478f4bfa-305a-4f56-bbad-38b77fc5bd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16f9e2845614304b6fffcc4ace92611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:47Z,use_quota=True,user_id='ca3cddca232b48dbb6570ad44c943e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadd1006-d8f2-4bf3-b35b-8071afe1826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadd1006-d8f2-4bf3-b35b-8071afe1826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f665fbea-fe49-4f48-993f-ad87a5ec6c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f665fbea-fe49-4f48-993f-ad87a5ec6c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478f4bfa-305a-4f56-bbad-38b77fc5bd9b', 'volume_name': 'volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8c479d-954e-48c0-bc6f-4aceef1ec20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8c479d-954e-48c0-bc6f-4aceef1ec20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7194989f-d97f-4e25-ad86-2278f982f451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Volume 478f4bfa-305a-4f56-bbad-38b77fc5bd9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b', 'volume_size': 1} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-522297766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478f4bfa-305a-4f56-bbad-38b77fc5bd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16f9e2845614304b6fffcc4ace92611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:47Z,use_quota=True,user_id='ca3cddca232b48dbb6570ad44c943e93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Creating volume 478f4bfa-305a-4f56-bbad-38b77fc5bd9b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:47 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:47 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b 1073741824 Sep 28 17:10:47 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-7d44b12a-4110-491c-a3f5-965ed66b1822 req-7c4cdd22-d992-4933-a972-52d81c5744a5 tempest-ServerActionsTestOtherA-1026857971 None] Terminate volume connection completed successfully. Sep 28 17:10:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-7d44b12a-4110-491c-a3f5-965ed66b1822 req-7c4cdd22-d992-4933-a972-52d81c5744a5 tempest-ServerActionsTestOtherA-1026857971 None] Deleting attachment 1b2741da-0ffa-4329-a011-98debb5c8338. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:48 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b 1073741824" returned: 0 in 1.376s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:48 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b Sep 28 17:10:48 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:49 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" returned: 0 in 0.618s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7194989f-d97f-4e25-ad86-2278f982f451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae1bd3b-ea63-4bda-b95f-c65b18db2c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Volume volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b (478f4bfa-305a-4f56-bbad-38b77fc5bd9b): created successfully Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae1bd3b-ea63-4bda-b95f-c65b18db2c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Flow 'volume_create_manager' (c19b62c3-904d-45af-84e5-1d7b7f586077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ccbe3332-b0fd-48cf-9b76-0afc61339559 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Created volume successfully. Sep 28 17:10:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Acquiring lock "cinder-478f4bfa-305a-4f56-bbad-38b77fc5bd9b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "cinder-478f4bfa-305a-4f56-bbad-38b77fc5bd9b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Acquiring lock "cinder-quobyte-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "cinder-quobyte-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[739b2c22-0d71-47d4-a3c8-5efecbd95577]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:54 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b Sep 28 17:10:54 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:54 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" returned: 0 in 0.843s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:55 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b Sep 28 17:10:55 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:55 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" returned: 0 in 0.633s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "cinder-quobyte-478f4bfa-305a-4f56-bbad-38b77fc5bd9b" released by "delete_volume" :: held 1.582s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Created reservations ['edfbcd9e-e43a-4995-b527-5631f69ee9c0', 'b53cb67a-bd6e-4c4a-a7fb-243c77114100', '504f8940-7980-4463-93db-d30780880b09', '9bb1d620-7cd1-4f7b-9408-074ba0ddca63'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:55 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:10:55 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:56 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.496s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:56 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Deleted volume successfully. Sep 28 17:10:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-29bc5877-1729-48b0-877e-4b9bd6adea73 tempest-VolumeQuotasNegativeTestJSON-389830636 None] Lock "cinder-478f4bfa-305a-4f56-bbad-38b77fc5bd9b-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Flow 'volume_create_manager' (100a3bcc-c4aa-4fe5-ab6b-3a3816382618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6ea4fc-f333-4e5e-88c0-82144ac5469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6ea4fc-f333-4e5e-88c0-82144ac5469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1892914401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29200280-cb8f-423d-a286-eed9434e9ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3c76d2cc0c4cb3a8c72f4ad6d8e6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:00Z,use_quota=True,user_id='3aa2bde142f044f8936536f3670ef46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb1ac19-3a90-4f9e-9b02-6adba0cf2400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb1ac19-3a90-4f9e-9b02-6adba0cf2400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0ce65c-47ba-49a1-9bd9-4013da074a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0ce65c-47ba-49a1-9bd9-4013da074a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29200280-cb8f-423d-a286-eed9434e9ef7', 'volume_name': 'volume-29200280-cb8f-423d-a286-eed9434e9ef7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2160cd-8391-4f14-aec3-e9e960d5d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2160cd-8391-4f14-aec3-e9e960d5d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6408f4a4-3357-41fe-bb7e-942e1b84274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Volume 29200280-cb8f-423d-a286-eed9434e9ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29200280-cb8f-423d-a286-eed9434e9ef7', 'volume_size': 1} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1892914401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29200280-cb8f-423d-a286-eed9434e9ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3c76d2cc0c4cb3a8c72f4ad6d8e6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:00Z,use_quota=True,user_id='3aa2bde142f044f8936536f3670ef46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Creating volume 29200280-cb8f-423d-a286-eed9434e9ef7 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:59 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:10:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:59 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 1073741824 Sep 28 17:10:59 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 1073741824" returned: 0 in 0.688s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:00 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 Sep 28 17:11:00 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Flow 'volume_create_manager' (b41f6efa-5d27-4e12-b535-27adb8d296a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ad612e-1801-43c1-b6cf-6d3c9a11231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ad612e-1801-43c1-b6cf-6d3c9a11231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860990779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f2b742-752f-4383-aae7-043d99f82a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66150c5aa044bcad3bb69933db01b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:01Z,use_quota=True,user_id='1a5efb74fb4d49d7b2b49092c1fed8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabd63a1-e0f8-4928-ac0a-f5bb6c76c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabd63a1-e0f8-4928-ac0a-f5bb6c76c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad844a06-de0b-4a2a-9639-1bf7a564847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:11:00 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7" returned: 0 in 0.364s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6408f4a4-3357-41fe-bb7e-942e1b84274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29200280-cb8f-423d-a286-eed9434e9ef7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327771c1-9176-4d73-a66e-00e61ef4f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:00 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Volume volume-29200280-cb8f-423d-a286-eed9434e9ef7 (29200280-cb8f-423d-a286-eed9434e9ef7): created successfully Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327771c1-9176-4d73-a66e-00e61ef4f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Flow 'volume_create_manager' (100a3bcc-c4aa-4fe5-ab6b-3a3816382618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5058d1fd-e924-4956-a412-4a93d83326a8 tempest-ServersNegativeTestJSON-1052376609 None] Created volume successfully. Sep 28 17:11:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad844a06-de0b-4a2a-9639-1bf7a564847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7f2b742-752f-4383-aae7-043d99f82a4a', 'volume_name': 'volume-e7f2b742-752f-4383-aae7-043d99f82a4a', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc1040-9d40-436a-a90a-95e0a8fa7b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70cc1040-9d40-436a-a90a-95e0a8fa7b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84dbd53e-1ab7-4fec-8974-144626405a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Volume e7f2b742-752f-4383-aae7-043d99f82a4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7f2b742-752f-4383-aae7-043d99f82a4a', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:11:01 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Trying to clone e7f2b742-752f-4383-aae7-043d99f82a4a from image fa438d18-3930-42ab-a121-0871daf80309 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:11:02 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[246da7d0-8df3-4c47-aae5-e490a932ce33]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:02 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD Sep 28 17:11:02 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:02 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 is fetched for user 1a5efb74fb4d49d7b2b49092c1fed8d5. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af242e9-2805-44db-a6c3-8f80ec07fd39]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:03 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD Sep 28 17:11:03 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:03 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-860990779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7f2b742-752f-4383-aae7-043d99f82a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66150c5aa044bcad3bb69933db01b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:01Z,use_quota=True,user_id='1a5efb74fb4d49d7b2b49092c1fed8d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Creating volume e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:03 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:03 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1073741824 Sep 28 17:11:03 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Flow 'volume_create_manager' (2684cfd2-ebe5-4107-976d-41a3fc994da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60bd589-142f-48c2-b3fa-dcf402d14dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60bd589-142f-48c2-b3fa-dcf402d14dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-61912390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3046854-218b-465f-bcb6-97f8df32e74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3c76d2cc0c4cb3a8c72f4ad6d8e6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:04Z,use_quota=True,user_id='3aa2bde142f044f8936536f3670ef46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4e86f1-2167-4ae5-9acc-05e88dcdc4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c4e86f1-2167-4ae5-9acc-05e88dcdc4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fed669-f557-4451-8d44-8e5cb27eaea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16fed669-f557-4451-8d44-8e5cb27eaea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3046854-218b-465f-bcb6-97f8df32e74c', 'volume_name': 'volume-b3046854-218b-465f-bcb6-97f8df32e74c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b46cc93-55ac-460e-b570-5304b0bfca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b46cc93-55ac-460e-b570-5304b0bfca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad23c7e4-61a4-476e-8a42-95c912251742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:04 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Volume b3046854-218b-465f-bcb6-97f8df32e74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3046854-218b-465f-bcb6-97f8df32e74c', 'volume_size': 1} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:04 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1073741824" returned: 0 in 0.769s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a Sep 28 17:11:04 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a" returned: 0 in 0.291s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-61912390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3046854-218b-465f-bcb6-97f8df32e74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3c76d2cc0c4cb3a8c72f4ad6d8e6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:04Z,use_quota=True,user_id='3aa2bde142f044f8936536f3670ef46c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Creating volume b3046854-218b-465f-bcb6-97f8df32e74c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:04 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c 1073741824 Sep 28 17:11:04 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Attempting download of fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume e7f2b742-752f-4383-aae7-043d99f82a4a. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bec0023-78d4-4275-ae82-a8adb0cf0368]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:04 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw Sep 28 17:11:04 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw" returned: 0 in 0.417s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c 1073741824" returned: 0 in 0.623s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw Sep 28 17:11:05 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c Sep 28 17:11:05 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw" returned: 1 in 0.444s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ibe_o0iw' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad6ef9b-d998-4444-8964-058f4dba6d08]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c" returned: 0 in 0.372s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad23c7e4-61a4-476e-8a42-95c912251742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3046854-218b-465f-bcb6-97f8df32e74c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be63eb7-746e-4033-8f60-00f0e1cb1019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:05 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD Sep 28 17:11:05 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Volume volume-b3046854-218b-465f-bcb6-97f8df32e74c (b3046854-218b-465f-bcb6-97f8df32e74c): created successfully Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be63eb7-746e-4033-8f60-00f0e1cb1019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Flow 'volume_create_manager' (2684cfd2-ebe5-4107-976d-41a3fc994da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-646c4f05-b2ff-4d7e-9b08-123ed2c82ba9 tempest-ServersNegativeTestJSON-1052376609 None] Created volume successfully. Sep 28 17:11:06 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] fa438d18-3930-42ab-a121-0871daf80309 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a Sep 28 17:11:06 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "cinder-b3046854-218b-465f-bcb6-97f8df32e74c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-b3046854-218b-465f-bcb6-97f8df32e74c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "cinder-quobyte-b3046854-218b-465f-bcb6-97f8df32e74c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-quobyte-b3046854-218b-465f-bcb6-97f8df32e74c" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ceadd4-e023-4615-9ad5-add0b66fddb9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c Sep 28 17:11:07 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:07 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:07 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c" returned: 0 in 0.657s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:07 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c Sep 28 17:11:07 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.518s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:08 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b3046854-218b-465f-bcb6-97f8df32e74c" returned: 0 in 0.496s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-quobyte-b3046854-218b-465f-bcb6-97f8df32e74c" released by "delete_volume" :: held 1.241s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Created reservations ['00ce663f-32cb-4665-ae85-94144bbbb59d', '330b8288-c8f0-4cfa-bfba-d9c3b79190ba', '67125928-c956-47e7-9e0c-fd9dc2619fe3', '6ddf9062-8869-43f2-adc1-8082586bc493'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:08 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:08 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:08 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.497s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Deleted volume successfully. Sep 28 17:11:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8b965b3a-1510-43ee-9464-9abd6750f90a tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-b3046854-218b-465f-bcb6-97f8df32e74c-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "cinder-29200280-cb8f-423d-a286-eed9434e9ef7-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-29200280-cb8f-423d-a286-eed9434e9ef7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "cinder-quobyte-29200280-cb8f-423d-a286-eed9434e9ef7" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-quobyte-29200280-cb8f-423d-a286-eed9434e9ef7" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:09 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a" returned: 0 in 3.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_72qvgamadevstack@QuobyteHD, size 112.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:11:09 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Converted 112.00 MB image at 33.10 MB/s Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc8bed-e4f1-40df-bf7c-c9c155c76d9f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:09 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1G Sep 28 17:11:09 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 Sep 28 17:11:09 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:09 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a 1G" returned: 0 in 0.539s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Downloaded image fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume e7f2b742-752f-4383-aae7-043d99f82a4a successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 for user 1a5efb74fb4d49d7b2b49092c1fed8d5 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Marking volume e7f2b742-752f-4383-aae7-043d99f82a4a as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Copying metadata from image fa438d18-3930-42ab-a121-0871daf80309 to e7f2b742-752f-4383-aae7-043d99f82a4a. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:11:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Creating volume glance metadata for volume e7f2b742-752f-4383-aae7-043d99f82a4a backed by image fa438d18-3930-42ab-a121-0871daf80309 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:11:10 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7" returned: 0 in 0.611s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:10 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7 Sep 28 17:11:10 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84dbd53e-1ab7-4fec-8974-144626405a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7f2b742-752f-4383-aae7-043d99f82a4a', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a59fc-b79c-4020-b08b-c685c3ad350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Volume volume-e7f2b742-752f-4383-aae7-043d99f82a4a (e7f2b742-752f-4383-aae7-043d99f82a4a): created successfully Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1a59fc-b79c-4020-b08b-c685c3ad350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Flow 'volume_create_manager' (b41f6efa-5d27-4e12-b535-27adb8d296a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c97ec715-d229-4268-bc40-ecff816eb143 tempest-ServerActionsTestOtherA-1026857971 None] Created volume successfully. Sep 28 17:11:10 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-29200280-cb8f-423d-a286-eed9434e9ef7" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-quobyte-29200280-cb8f-423d-a286-eed9434e9ef7" released by "delete_volume" :: held 1.068s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Created reservations ['9cfa58f8-a119-457b-ac44-ea6f2f06bb2e', '399de3d4-2923-446d-9428-5027d9c5f53b', '68c5eb82-2c0f-4c48-8b9a-5e93e4716157', '2a25105a-65b8-4fae-a6e3-e8d7a857e9d7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:10 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:10 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (7033d4a0-d0bb-4372-af62-003fc99e80aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf53130-bcf9-4841-bff4-4494036a889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf53130-bcf9-4841-bff4-4494036a889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-606163263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe613125-8125-4833-873f-1b3c160e6da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:11Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a04469-2c7d-4d88-889b-2b60f2bd7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a04469-2c7d-4d88-889b-2b60f2bd7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a405f2-2fe9-46b5-ab4c-9cf19b9f9f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a405f2-2fe9-46b5-ab4c-9cf19b9f9f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe613125-8125-4833-873f-1b3c160e6da4', 'volume_name': 'volume-fe613125-8125-4833-873f-1b3c160e6da4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328c17c9-7a2f-45ce-80b1-7b757fa6dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328c17c9-7a2f-45ce-80b1-7b757fa6dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addec55f-17f6-4fa1-8a32-afdce25a6788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Volume fe613125-8125-4833-873f-1b3c160e6da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe613125-8125-4833-873f-1b3c160e6da4', 'volume_size': 1} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-606163263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe613125-8125-4833-873f-1b3c160e6da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:11Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Creating volume fe613125-8125-4833-873f-1b3c160e6da4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:10 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:11 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 1073741824 Sep 28 17:11:11 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:11 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:11 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Deleted volume successfully. Sep 28 17:11:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b87ad42b-f31e-402b-9c40-7c17d22ae12f tempest-ServersNegativeTestJSON-1052376609 None] Lock "cinder-29200280-cb8f-423d-a286-eed9434e9ef7-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:11 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 1073741824" returned: 0 in 0.654s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:11 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 Sep 28 17:11:11 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:12 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4" returned: 0 in 0.498s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addec55f-17f6-4fa1-8a32-afdce25a6788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe613125-8125-4833-873f-1b3c160e6da4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955921f7-09ee-460f-9553-16dce62554d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:12 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Volume volume-fe613125-8125-4833-873f-1b3c160e6da4 (fe613125-8125-4833-873f-1b3c160e6da4): created successfully Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955921f7-09ee-460f-9553-16dce62554d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (7033d4a0-d0bb-4372-af62-003fc99e80aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-583b2248-8401-46ad-9a8c-69ecfd1fa5e7 tempest-AttachVolumeTestJSON-667897622 None] Created volume successfully. Sep 28 17:11:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-95201f3a-85dc-4c03-abb8-888a543c1802 req-bdef93a5-3adb-4df6-be4e-79a705896dd6 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-95201f3a-85dc-4c03-abb8-888a543c1802 req-bdef93a5-3adb-4df6-be4e-79a705896dd6 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-95201f3a-85dc-4c03-abb8-888a543c1802 req-bdef93a5-3adb-4df6-be4e-79a705896dd6 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-95201f3a-85dc-4c03-abb8-888a543c1802 req-bdef93a5-3adb-4df6-be4e-79a705896dd6 tempest-AttachVolumeTestJSON-667897622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-fe613125-8125-4833-873f-1b3c160e6da4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc275722-4538-4f14-8386-57d2d07b3ef0', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:14 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-95201f3a-85dc-4c03-abb8-888a543c1802 req-bdef93a5-3adb-4df6-be4e-79a705896dd6 tempest-AttachVolumeTestJSON-667897622 None] attachment_update completed successfully. Sep 28 17:11:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-34567e2e-117f-42f8-9558-3f9b16bbdbeb req-c39df45b-618e-4034-a16e-f2b76cb94245 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-34567e2e-117f-42f8-9558-3f9b16bbdbeb req-c39df45b-618e-4034-a16e-f2b76cb94245 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-34567e2e-117f-42f8-9558-3f9b16bbdbeb req-c39df45b-618e-4034-a16e-f2b76cb94245 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-34567e2e-117f-42f8-9558-3f9b16bbdbeb req-c39df45b-618e-4034-a16e-f2b76cb94245 tempest-ServerActionsTestOtherA-1026857971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-e7f2b742-752f-4383-aae7-043d99f82a4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54dcf236-3426-4599-b559-734f878d1ff8', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:18 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-34567e2e-117f-42f8-9558-3f9b16bbdbeb req-c39df45b-618e-4034-a16e-f2b76cb94245 tempest-ServerActionsTestOtherA-1026857971 None] attachment_update completed successfully. Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (e3586ec9-487d-42e6-bd92-f23ab9f08b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a5781-4c15-46b7-a0f2-1d2278ff315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4a5781-4c15-46b7-a0f2-1d2278ff315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1579156979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdef1092-3a84-42c8-aaf1-aaada37476f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:19Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf61df28-f2f1-4491-81f2-21e72527ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf61df28-f2f1-4491-81f2-21e72527ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac5681-eff9-4c8f-bdbd-f7450f784be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac5681-eff9-4c8f-bdbd-f7450f784be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdef1092-3a84-42c8-aaf1-aaada37476f9', 'volume_name': 'volume-bdef1092-3a84-42c8-aaf1-aaada37476f9', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3d536d-56e5-442e-8aa8-14da4ea2ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3d536d-56e5-442e-8aa8-14da4ea2ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7da7d11-5e8d-47c0-b657-3037012f54a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Volume bdef1092-3a84-42c8-aaf1-aaada37476f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdef1092-3a84-42c8-aaf1-aaada37476f9', 'volume_size': 1} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1579156979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdef1092-3a84-42c8-aaf1-aaada37476f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b113fb05a6464045bffc8ce681761fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:19Z,use_quota=True,user_id='d6e7eaf5b41948bd817ae051b7ab55ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Creating volume bdef1092-3a84-42c8-aaf1-aaada37476f9 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:19 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:19 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 1073741824 Sep 28 17:11:19 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Flow 'volume_create_manager' (9853d6d6-2f16-47bd-8270-b6464f8fdf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812b9e02-b941-4ca7-9e84-74fd68e9b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812b9e02-b941-4ca7-9e84-74fd68e9b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2020927708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db94f16c-f64b-444e-9ba1-f1d4921cc981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='912e72ba757d49c9923ea339a43a626d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:20Z,use_quota=True,user_id='dc2d65f4afe245eeab5f751dbcb5ea84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f63469-14e8-473a-ae48-476b88dabe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f63469-14e8-473a-ae48-476b88dabe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985b48c6-ca2d-40b2-9080-ba7ae087102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985b48c6-ca2d-40b2-9080-ba7ae087102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db94f16c-f64b-444e-9ba1-f1d4921cc981', 'volume_name': 'volume-db94f16c-f64b-444e-9ba1-f1d4921cc981', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5267d5ba-1f74-4891-b801-cae1ff3fd3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5267d5ba-1f74-4891-b801-cae1ff3fd3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e1e481-a1bf-4815-b2f8-ed851ce345dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:20 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Volume db94f16c-f64b-444e-9ba1-f1d4921cc981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db94f16c-f64b-444e-9ba1-f1d4921cc981', 'volume_size': 1} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:20 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 1073741824" returned: 0 in 0.757s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:20 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 Sep 28 17:11:20 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:20 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9" returned: 0 in 0.393s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2020927708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db94f16c-f64b-444e-9ba1-f1d4921cc981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='912e72ba757d49c9923ea339a43a626d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:20Z,use_quota=True,user_id='dc2d65f4afe245eeab5f751dbcb5ea84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Creating volume db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:20 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7da7d11-5e8d-47c0-b657-3037012f54a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdef1092-3a84-42c8-aaf1-aaada37476f9', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:21 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 1073741824 Sep 28 17:11:21 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c051891c-bb09-45af-bd7e-3a1cdf8bc323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Volume volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 (bdef1092-3a84-42c8-aaf1-aaada37476f9): created successfully Sep 28 17:11:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c051891c-bb09-45af-bd7e-3a1cdf8bc323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Flow 'volume_create_manager' (e3586ec9-487d-42e6-bd92-f23ab9f08b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5030d0eb-21af-455b-a2e8-e5fb951b83f3 tempest-AttachVolumeTestJSON-667897622 None] Created volume successfully. Sep 28 17:11:21 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 1073741824" returned: 0 in 0.780s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:21 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 Sep 28 17:11:21 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:22 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981" returned: 0 in 0.606s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e1e481-a1bf-4815-b2f8-ed851ce345dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db94f16c-f64b-444e-9ba1-f1d4921cc981', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4717b412-88e6-470b-83b6-ee41c0dce0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Volume volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 (db94f16c-f64b-444e-9ba1-f1d4921cc981): created successfully Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4717b412-88e6-470b-83b6-ee41c0dce0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Flow 'volume_create_manager' (9853d6d6-2f16-47bd-8270-b6464f8fdf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fe102b8c-dbd3-40b4-8cf1-9fe734ca4c7e tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Created volume successfully. Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-2d31b1fa-3660-4ff5-aa5c-002466f2a3cd req-99b6f175-548f-4eb6-9ff4-b2a6d04616d0 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-2d31b1fa-3660-4ff5-aa5c-002466f2a3cd req-99b6f175-548f-4eb6-9ff4-b2a6d04616d0 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-2d31b1fa-3660-4ff5-aa5c-002466f2a3cd req-99b6f175-548f-4eb6-9ff4-b2a6d04616d0 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-2d31b1fa-3660-4ff5-aa5c-002466f2a3cd req-99b6f175-548f-4eb6-9ff4-b2a6d04616d0 tempest-AttachVolumeTestJSON-667897622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-bdef1092-3a84-42c8-aaf1-aaada37476f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '333daf68-4249-4e13-9644-9b078512e0a0', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-2d31b1fa-3660-4ff5-aa5c-002466f2a3cd req-99b6f175-548f-4eb6-9ff4-b2a6d04616d0 tempest-AttachVolumeTestJSON-667897622 None] attachment_update completed successfully. Sep 28 17:11:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Creating offline snapshot 757d8666-bb9a-41ea-bc24-e51a270740b5 of volume db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:11:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1ba2ae-2f45-472d-9380-397591add30c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:24 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 Sep 28 17:11:24 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:24 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981" returned: 0 in 0.957s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:24 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 1G Sep 28 17:11:24 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:25 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 1G" returned: 0 in 0.920s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:25 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 Sep 28 17:11:25 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:26 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5" returned: 0 in 0.506s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:26 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 is being set with open permissions: ugo+rw Sep 28 17:11:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:26 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 Sep 28 17:11:26 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:26 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:26 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info Sep 28 17:11:26 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:27 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info" returned: 0 in 0.502s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:27 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info is being set with open permissions: ugo+rw Sep 28 17:11:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:27 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info Sep 28 17:11:27 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:27 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.info" returned: 0 in 0.607s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-96bb3cfd-b65d-462c-a127-77e7468c49d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Create snapshot completed successfully Sep 28 17:11:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-61b6fcb7-2d72-4179-95cc-1cbecec53c1b req-d9898a44-66eb-4ce9-ac0c-53e95c5f6951 tempest-AttachVolumeTestJSON-667897622 None] Terminate volume connection completed successfully. Sep 28 17:11:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-61b6fcb7-2d72-4179-95cc-1cbecec53c1b req-d9898a44-66eb-4ce9-ac0c-53e95c5f6951 tempest-AttachVolumeTestJSON-667897622 None] Deleting attachment fc275722-4538-4f14-8386-57d2d07b3ef0. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "cinder-757d8666-bb9a-41ea-bc24-e51a270740b5-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-757d8666-bb9a-41ea-bc24-e51a270740b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "cinder-quobyte-757d8666-bb9a-41ea-bc24-e51a270740b5" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-757d8666-bb9a-41ea-bc24-e51a270740b5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Deleting offline snapshot 757d8666-bb9a-41ea-bc24-e51a270740b5 of volume db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] snapshot_file for this snap is: volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd3d764-a395-42ba-bca3-b9618c7a3b32]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:30 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 Sep 28 17:11:30 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-231b0d29-7cda-4e25-adbc-4fde02a267ec req-bfc196ae-7ab1-4ea9-8906-89b190533527 tempest-AttachVolumeTestJSON-667897622 None] Terminate volume connection completed successfully. Sep 28 17:11:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-231b0d29-7cda-4e25-adbc-4fde02a267ec req-bfc196ae-7ab1-4ea9-8906-89b190533527 tempest-AttachVolumeTestJSON-667897622 None] Deleting attachment 333daf68-4249-4e13-9644-9b078512e0a0. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:11:31 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5" returned: 0 in 0.968s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db94f16c-f64b-444e-9ba1-f1d4921cc981(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:11:31 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25232f-16c7-43c0-9111-bd04b283b5a1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:31 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 Sep 28 17:11:31 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981" returned: 0 in 0.661s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:32 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 Sep 28 17:11:32 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:32 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5" returned: 0 in 0.778s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:32 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5 Sep 28 17:11:32 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:33 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981.757d8666-bb9a-41ea-bc24-e51a270740b5" returned: 0 in 0.668s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-757d8666-bb9a-41ea-bc24-e51a270740b5" released by "_delete_snapshot" :: held 3.323s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" released by "delete_snapshot" :: held 3.378s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:33 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Created reservations ['7cab8c02-6b14-4280-9440-caf7cc634635', '5984fcc3-e4f5-4a4e-ad44-70ce07d662f9', 'a94a2666-aee8-4479-9bb8-cc110d87e3f2', '391345df-49d8-4c34-99c2-e1ff37f36420'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Delete snapshot completed successfully. Sep 28 17:11:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b4d7b2f-2af7-4f9e-beb6-67452f9ff513 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-757d8666-bb9a-41ea-bc24-e51a270740b5-delete_snapshot" released by "delete_snapshot" :: held 3.813s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "cinder-db94f16c-f64b-444e-9ba1-f1d4921cc981-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-db94f16c-f64b-444e-9ba1-f1d4921cc981-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" acquired by "delete_volume" :: waited 0.057s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1550326-032f-4738-a608-924910d05121]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:35 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 Sep 28 17:11:35 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:36 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981" returned: 0 in 1.004s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:36 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981 Sep 28 17:11:36 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:37 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-db94f16c-f64b-444e-9ba1-f1d4921cc981" returned: 0 in 0.897s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-quobyte-db94f16c-f64b-444e-9ba1-f1d4921cc981" released by "delete_volume" :: held 2.113s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=54,cinder:SELECT=79,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Created reservations ['0bc80906-a246-4f88-984e-79f4a22315b2', '59c7f044-39fd-478c-865a-f454eb642872', 'fde95dd8-11a7-4809-a670-7f838b3f3afe', '4c5b26c5-ab11-462c-aefb-ce01f32b5b62'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=66,cinder:UPDATE=67,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:37 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:38 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:38 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Deleted volume successfully. Sep 28 17:11:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2699c183-262c-4d1c-9029-06a36668e0d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1351216940 None] Lock "cinder-db94f16c-f64b-444e-9ba1-f1d4921cc981-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-bdef1092-3a84-42c8-aaf1-aaada37476f9-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-bdef1092-3a84-42c8-aaf1-aaada37476f9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-quobyte-bdef1092-3a84-42c8-aaf1-aaada37476f9" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-bdef1092-3a84-42c8-aaf1-aaada37476f9" acquired by "delete_volume" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39242e-ba1e-4991-bc5f-fad53bc91636]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:44 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 Sep 28 17:11:44 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:44 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9" returned: 0 in 0.736s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:44 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9 Sep 28 17:11:44 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:45 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bdef1092-3a84-42c8-aaf1-aaada37476f9" returned: 0 in 0.721s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-bdef1092-3a84-42c8-aaf1-aaada37476f9" released by "delete_volume" :: held 1.562s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Created reservations ['d268229f-412c-4598-a246-2c09fc69a0fc', '2e80b93c-cf62-4cbd-9c78-1b4db007716a', '9e90448c-dedf-40ad-a15f-634fc8cc9dc1', 'e74e8fb2-46e5-46eb-b514-400e42bb84a7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:45 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:45 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:46 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.465s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Deleted volume successfully. Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f19a4610-ec44-4a93-9e63-7455e55a7a16 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-bdef1092-3a84-42c8-aaf1-aaada37476f9-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-fe613125-8125-4833-873f-1b3c160e6da4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-fe613125-8125-4833-873f-1b3c160e6da4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-quobyte-fe613125-8125-4833-873f-1b3c160e6da4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-fe613125-8125-4833-873f-1b3c160e6da4" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24cfbc-d0c1-47ee-b359-a080c82a64eb]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:46 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 Sep 28 17:11:46 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:47 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4" returned: 0 in 0.625s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:47 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4 Sep 28 17:11:47 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-eb957d1f-c936-4246-adca-268be1ed9e2c tempest-ServerActionsTestOtherA-1026857971 None] Terminate volume connection completed successfully. Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-eb957d1f-c936-4246-adca-268be1ed9e2c tempest-ServerActionsTestOtherA-1026857971 None] Deleting attachment 54dcf236-3426-4599-b559-734f878d1ff8. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:11:47 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fe613125-8125-4833-873f-1b3c160e6da4" returned: 0 in 0.598s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-fe613125-8125-4833-873f-1b3c160e6da4" released by "delete_volume" :: held 1.334s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Created reservations ['da49598c-ba00-41b6-bb7a-64047de4301d', 'd53198b2-07cf-4e98-bb0c-11a885d551b0', '37771cd9-7f08-4391-b54d-eb7c3692fd0d', '77e099dc-da56-42d1-9a4f-e7f9acaf8b61'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:48 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:48 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:48 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Deleted volume successfully. Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bfe4aee4-8402-4521-aef4-a9728d634de7 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-fe613125-8125-4833-873f-1b3c160e6da4-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-8818cbe2-e92d-4446-a42c-866f140e9e7f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-8818cbe2-e92d-4446-a42c-866f140e9e7f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "cinder-quobyte-8818cbe2-e92d-4446-a42c-866f140e9e7f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-8818cbe2-e92d-4446-a42c-866f140e9e7f" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976bf16-e91a-462f-a194-b39b7829eb4b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f Sep 28 17:11:49 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f" returned: 0 in 0.687s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:49 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f Sep 28 17:11:49 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-64f522b1-fa9e-4998-9293-8752545e5092 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-64f522b1-fa9e-4998-9293-8752545e5092 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-64f522b1-fa9e-4998-9293-8752545e5092 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-64f522b1-fa9e-4998-9293-8752545e5092 tempest-ServerActionsTestOtherA-1026857971 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-e7f2b742-752f-4383-aae7-043d99f82a4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f01f91ae-b3af-4659-9a7d-14ad16aa8bfb', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:50 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8818cbe2-e92d-4446-a42c-866f140e9e7f" returned: 0 in 0.409s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-quobyte-8818cbe2-e92d-4446-a42c-866f140e9e7f" released by "delete_volume" :: held 1.177s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-033f0eaa-3101-4ed2-8d29-2cfb427750ab req-64f522b1-fa9e-4998-9293-8752545e5092 tempest-ServerActionsTestOtherA-1026857971 None] attachment_update completed successfully. Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Created reservations ['de1a8b3f-dad0-4371-a32f-56ba03040707', '00f1f541-0c65-440d-abc8-e18469add6e0', 'aefe66ed-a42f-489e-91a9-8a6a97a2affa', 'dfedb2f5-0378-4441-9c15-9665234b498a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:50 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:50 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:50 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Deleted volume successfully. Sep 28 17:11:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e25c1fc-a7b3-4cb6-a3c1-f55183845df3 tempest-AttachVolumeTestJSON-667897622 None] Lock "cinder-8818cbe2-e92d-4446-a42c-866f140e9e7f-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Flow 'volume_create_manager' (46ba2fcf-2bbb-4432-b693-35ccee05149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca015927-9abc-47c0-8b58-e7ce6801ba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca015927-9abc-47c0-8b58-e7ce6801ba3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-599636634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fed5613-9db1-4eac-8081-858e56390905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96e6cd221824797a1e40560afcc85af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:54Z,use_quota=True,user_id='f4c15ee90ebf4fb9bd84db277b7b52cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f80abf4-657e-437d-b3a4-5853b0e97def),volume_type_id=5f80abf4-657e-437d-b3a4-5853b0e97def)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59c7a32-dd88-499d-825c-ae9239ac0967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59c7a32-dd88-499d-825c-ae9239ac0967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25d7451-dacc-4933-8736-7d10cceb983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25d7451-dacc-4933-8736-7d10cceb983e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fed5613-9db1-4eac-8081-858e56390905', 'volume_name': 'volume-1fed5613-9db1-4eac-8081-858e56390905', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44e42ec-8572-4b94-93eb-f943bf2cdea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44e42ec-8572-4b94-93eb-f943bf2cdea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033f6d0-1b28-4666-aa6c-7bd66747fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:54 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Volume 1fed5613-9db1-4eac-8081-858e56390905: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fed5613-9db1-4eac-8081-858e56390905', 'volume_size': 1} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-599636634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fed5613-9db1-4eac-8081-858e56390905,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96e6cd221824797a1e40560afcc85af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:54Z,use_quota=True,user_id='f4c15ee90ebf4fb9bd84db277b7b52cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f80abf4-657e-437d-b3a4-5853b0e97def),volume_type_id=5f80abf4-657e-437d-b3a4-5853b0e97def)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Creating volume 1fed5613-9db1-4eac-8081-858e56390905 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:54 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:11:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 1073741824 Sep 28 17:11:54 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 1073741824" returned: 0 in 1.094s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 Sep 28 17:11:55 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:56 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2033f6d0-1b28-4666-aa6c-7bd66747fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fed5613-9db1-4eac-8081-858e56390905', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135a5ec1-e7a2-47eb-adcf-27b87bcc39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Volume volume-1fed5613-9db1-4eac-8081-858e56390905 (1fed5613-9db1-4eac-8081-858e56390905): created successfully Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135a5ec1-e7a2-47eb-adcf-27b87bcc39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Flow 'volume_create_manager' (46ba2fcf-2bbb-4432-b693-35ccee05149c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8e595ef4-181b-4845-89ba-bbe1ec9cb51b tempest-VolumeTypesAccessTest-231651669 None] Created volume successfully. Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Acquiring lock "cinder-1fed5613-9db1-4eac-8081-858e56390905-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "cinder-1fed5613-9db1-4eac-8081-858e56390905-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Acquiring lock "cinder-quobyte-1fed5613-9db1-4eac-8081-858e56390905" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "cinder-quobyte-1fed5613-9db1-4eac-8081-858e56390905" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:57 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd36fe98-74c3-406b-95a5-f476a20c8192]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 Sep 28 17:11:57 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905" returned: 0 in 0.709s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905 Sep 28 17:11:57 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1fed5613-9db1-4eac-8081-858e56390905" returned: 0 in 0.588s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "cinder-quobyte-1fed5613-9db1-4eac-8081-858e56390905" released by "delete_volume" :: held 1.397s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:58 devstack cinder-volume[86929]: WARNING cinder.quota [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-12455901 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-12455901, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:58 devstack cinder-volume[86929]: WARNING cinder.quota [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-12455901 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-12455901, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Created reservations ['7caefd92-2310-4f9f-a327-a5a95f184fef', '8a28cca0-9ac3-4236-b164-78f736c43bef', '67ef702a-eea8-489e-9c03-5c9a3ca4c23d', '7a932663-899c-4251-9fda-3ef504b5b64a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:11:58 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:59 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.891s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Deleted volume successfully. Sep 28 17:11:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a5bbba93-50a8-4da9-ab72-dd11d0f9e55a tempest-VolumeTypesAccessTest-231651669 None] Lock "cinder-1fed5613-9db1-4eac-8081-858e56390905-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-49fd203a-a89c-4bb4-b2de-be35d0a28385 tempest-GroupsTest-1964288719 None] Group tempest-Group1-478799554: creating Sep 28 17:12:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-49fd203a-a89c-4bb4-b2de-be35d0a28385 tempest-GroupsTest-1964288719 None] Group tempest-Group1-478799554: created successfully Sep 28 17:12:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-49fd203a-a89c-4bb4-b2de-be35d0a28385 tempest-GroupsTest-1964288719 None] Create group completed successfully. Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:07 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:07 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.528s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-48992429-4cd7-479a-8068-267253256dc7 tempest-GroupsTest-1964288719 None] Group tempest-Group2-533525606: creating Sep 28 17:12:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-48992429-4cd7-479a-8068-267253256dc7 tempest-GroupsTest-1964288719 None] Group tempest-Group2-533525606: created successfully Sep 28 17:12:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-48992429-4cd7-479a-8068-267253256dc7 tempest-GroupsTest-1964288719 None] Create group completed successfully. Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (ae6bcf61-925b-48ed-bd27-a96a12630df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db84d54f-57f0-4731-bd2e-9a4cc40594e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db84d54f-57f0-4731-bd2e-9a4cc40594e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420140437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1acd559f-1d48-46e0-ac4d-4858d171fdfb,host='devstack@QuobyteHD#QuobyteHD',id=fefa9d83-7814-4495-b263-d050c8bbc954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9a99765-d065-4a61-8c18-b3726bc7d4bd),volume_type_id=d9a99765-d065-4a61-8c18-b3726bc7d4bd)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1644b205-e2ee-412d-aa54-38a6c3df53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1644b205-e2ee-412d-aa54-38a6c3df53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f01f7-4f76-4e12-806d-e6fda9814983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f01f7-4f76-4e12-806d-e6fda9814983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fefa9d83-7814-4495-b263-d050c8bbc954', 'volume_name': 'volume-fefa9d83-7814-4495-b263-d050c8bbc954', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28c051c-3cb7-499d-9f99-3a32d1059fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28c051c-3cb7-499d-9f99-3a32d1059fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68894266-4d3c-44a4-8a73-9b3698b5b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Volume fefa9d83-7814-4495-b263-d050c8bbc954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fefa9d83-7814-4495-b263-d050c8bbc954', 'volume_size': 1} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1acd559f-1d48-46e0-ac4d-4858d171fdfb,created_at=2026-09-28T15:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-420140437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1acd559f-1d48-46e0-ac4d-4858d171fdfb,host='devstack@QuobyteHD#QuobyteHD',id=fefa9d83-7814-4495-b263-d050c8bbc954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:11Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9a99765-d065-4a61-8c18-b3726bc7d4bd),volume_type_id=d9a99765-d065-4a61-8c18-b3726bc7d4bd)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Creating volume fefa9d83-7814-4495-b263-d050c8bbc954 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:10 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 1073741824 Sep 28 17:12:11 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 1073741824" returned: 0 in 0.674s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 Sep 28 17:12:11 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1d24b2bf-48c1-4350-9368-1b51e2550a54 tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1822879652: creating Sep 28 17:12:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1d24b2bf-48c1-4350-9368-1b51e2550a54 tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1822879652: created successfully Sep 28 17:12:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1d24b2bf-48c1-4350-9368-1b51e2550a54 tempest-GroupSnapshotsTest-1150459424 None] Create group completed successfully. Sep 28 17:12:12 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954" returned: 0 in 0.557s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68894266-4d3c-44a4-8a73-9b3698b5b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fefa9d83-7814-4495-b263-d050c8bbc954', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48796e0b-7478-4759-ba91-f2200de408a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:12 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Volume volume-fefa9d83-7814-4495-b263-d050c8bbc954 (fefa9d83-7814-4495-b263-d050c8bbc954): created successfully Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48796e0b-7478-4759-ba91-f2200de408a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (ae6bcf61-925b-48ed-bd27-a96a12630df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c1525cf0-5394-482d-a268-edc387dc2496 tempest-GroupsTest-1964288719 None] Created volume successfully. Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (21e87897-66e4-4cef-bd13-46b25b5cba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfd35d7-9893-4bec-9912-9ff9ba212fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfd35d7-9893-4bec-9912-9ff9ba212fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-5768922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6223a002-f917-4ddd-8c49-78f236a3c4d8,host='devstack@QuobyteHD#QuobyteHD',id=520dc3ef-e5f4-46d2-a07e-fbefb2098914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:14Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcdf0a1-1710-455c-9116-5ddf7447b74f),volume_type_id=ffcdf0a1-1710-455c-9116-5ddf7447b74f)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef02f316-4586-4587-8d29-ac12e2543667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef02f316-4586-4587-8d29-ac12e2543667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76844d-d64f-4400-b386-86362eea5252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef76844d-d64f-4400-b386-86362eea5252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '520dc3ef-e5f4-46d2-a07e-fbefb2098914', 'volume_name': 'volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fff995-9343-46d6-9db3-ad8034402639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fff995-9343-46d6-9db3-ad8034402639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4765b363-634d-4bbf-96cd-d30ec7bd639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:14 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Volume 520dc3ef-e5f4-46d2-a07e-fbefb2098914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914', 'volume_size': 1} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6223a002-f917-4ddd-8c49-78f236a3c4d8,created_at=2026-09-28T15:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-5768922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6223a002-f917-4ddd-8c49-78f236a3c4d8,host='devstack@QuobyteHD#QuobyteHD',id=520dc3ef-e5f4-46d2-a07e-fbefb2098914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:14Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffcdf0a1-1710-455c-9116-5ddf7447b74f),volume_type_id=ffcdf0a1-1710-455c-9116-5ddf7447b74f)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Creating volume 520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:14 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:14 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 1073741824 Sep 28 17:12:14 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Acquiring lock "cinder-quobyte-fefa9d83-7814-4495-b263-d050c8bbc954" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-fefa9d83-7814-4495-b263-d050c8bbc954" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08f5ff-c7e6-42e6-99b9-0f1478d5e591]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 Sep 28 17:12:15 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 1073741824" returned: 0 in 0.960s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:15 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 0.374s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:15 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954" returned: 0 in 0.765s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4765b363-634d-4bbf-96cd-d30ec7bd639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af768eda-4bf1-41c2-a66d-ebfbe231166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:15 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954 Sep 28 17:12:15 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:15 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Volume volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 (520dc3ef-e5f4-46d2-a07e-fbefb2098914): created successfully Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af768eda-4bf1-41c2-a66d-ebfbe231166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (21e87897-66e4-4cef-bd13-46b25b5cba96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:15 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-17483a2e-c38e-4966-9289-b842a19162a3 tempest-GroupSnapshotsTest-1150459424 None] Created volume successfully. Sep 28 17:12:16 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fefa9d83-7814-4495-b263-d050c8bbc954" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-fefa9d83-7814-4495-b263-d050c8bbc954" released by "delete_volume" :: held 1.330s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Created reservations ['088c8329-fc1a-42ba-b528-13c983bf82bc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-82935718 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-82935718, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-82935718 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-82935718, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Created reservations ['709dc4fd-5f8f-4813-a85d-c0786880ca18', '8f824290-9c04-4bd9-b3e9-56371b689bad', 'aac1867e-beab-449b-9c34-693ade7d7b65', 'e32c99b4-0028-4b6b-8c95-63b8c95aea7e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:16 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:16 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] GroupSnapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: creating. Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Group snapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: creating. {{(pid=86929) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:12:17 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.463s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c50dd134-881c-4441-82e7-4600163d6aa3 tempest-GroupsTest-1964288719 None] Delete group completed successfully. Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Creating offline snapshot a77e957f-7b16-4aac-b314-6de759960ea2 of volume 520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e54ac2d-f88b-4d2a-8ded-5520b26ba805]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:17 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Created reservations ['fa9095b6-051c-4c27-a17a-6792868247a3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:17 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 0.547s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:17 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:17 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:17 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 1G Sep 28 17:12:17 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:18 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.305s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:18 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-84d38b3c-8f51-426f-b938-7cb8e41078b1 tempest-GroupsTest-1964288719 None] Delete group completed successfully. Sep 28 17:12:18 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 1G" returned: 0 in 0.677s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:18 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.491s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:19 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.471s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info Sep 28 17:12:19 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8d2d5352-0195-42f6-9e86-9861c8290291 tempest-GroupsTest-1964288719 None] Group tempest-GroupsTest-Group-494712434: creating Sep 28 17:12:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8d2d5352-0195-42f6-9e86-9861c8290291 tempest-GroupsTest-1964288719 None] Group tempest-GroupsTest-Group-494712434: created successfully Sep 28 17:12:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8d2d5352-0195-42f6-9e86-9861c8290291 tempest-GroupsTest-1964288719 None] Create group completed successfully. Sep 28 17:12:19 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info" returned: 0 in 0.350s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:12:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info Sep 28 17:12:19 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.info" returned: 0 in 0.366s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-257daa8a-49f6-4aa9-90e6-ded17c61f4aa tempest-GroupSnapshotsTest-1150459424 None] group_snapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: created successfully Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (796379c6-38ce-4c0d-88f9-d77a61ec142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f0b1d-198d-442d-bab7-dc20ff252f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f0b1d-198d-442d-bab7-dc20ff252f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321193580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7604b901-0f8e-477e-ba1e-0817ad96a302,host='devstack@QuobyteHD#QuobyteHD',id=ef5a2729-6772-48ef-b029-4a49a1e16be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:21Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34fb06c8-a867-488b-ac9e-248a592c373a),volume_type_id=34fb06c8-a867-488b-ac9e-248a592c373a)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aed6e6-84a3-4e17-a811-3626ebc3284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8aed6e6-84a3-4e17-a811-3626ebc3284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119404be-d0a5-4bd2-9456-8f39f3a9eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119404be-d0a5-4bd2-9456-8f39f3a9eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5a2729-6772-48ef-b029-4a49a1e16be0', 'volume_name': 'volume-ef5a2729-6772-48ef-b029-4a49a1e16be0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41944243-a9aa-4126-8587-e9bf8e14d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41944243-a9aa-4126-8587-e9bf8e14d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd286d51-98a3-4343-bdc0-e6368d6e2e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Volume ef5a2729-6772-48ef-b029-4a49a1e16be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5a2729-6772-48ef-b029-4a49a1e16be0', 'volume_size': 1} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7604b901-0f8e-477e-ba1e-0817ad96a302,created_at=2026-09-28T15:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321193580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7604b901-0f8e-477e-ba1e-0817ad96a302,host='devstack@QuobyteHD#QuobyteHD',id=ef5a2729-6772-48ef-b029-4a49a1e16be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:21Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34fb06c8-a867-488b-ac9e-248a592c373a),volume_type_id=34fb06c8-a867-488b-ac9e-248a592c373a)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Creating volume ef5a2729-6772-48ef-b029-4a49a1e16be0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:21 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:21 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 1073741824 Sep 28 17:12:21 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:22 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 1073741824" returned: 0 in 0.615s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:22 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 Sep 28 17:12:22 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:22 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0" returned: 0 in 0.409s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.062s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2-ade5881c-7abb-4266-ba2a-3cd889123786" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd286d51-98a3-4343-bdc0-e6368d6e2e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5a2729-6772-48ef-b029-4a49a1e16be0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b72f87-e6d4-4318-8a0d-bddc5e711833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2-ade5881c-7abb-4266-ba2a-3cd889123786" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Creating volume ade5881c-7abb-4266-ba2a-3cd889123786 from snapshot a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Volume volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 (ef5a2729-6772-48ef-b029-4a49a1e16be0): created successfully Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b72f87-e6d4-4318-8a0d-bddc5e711833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (796379c6-38ce-4c0d-88f9-d77a61ec142c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] snapshot: a77e957f-7b16-4aac-b314-6de759960ea2, volume: ade5881c-7abb-4266-ba2a-3cd889123786, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e048eaa3-8241-4525-b1a5-0013601a02c0 tempest-GroupsTest-1964288719 None] Created volume successfully. Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed98c4-6f3c-4cc4-b419-af9c326b7a5d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:22 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:22 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.451s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91dcc6f-5ea1-4882-b230-7d4167953e2b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:23 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:23 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 0.569s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 Sep 28 17:12:23 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (d811c274-f9a1-4a70-84d3-7d66984261c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d8e4d-a82f-4c18-b5b1-98b439f6d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4d8e4d-a82f-4c18-b5b1-98b439f6d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122378454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7604b901-0f8e-477e-ba1e-0817ad96a302,host='devstack@QuobyteHD#QuobyteHD',id=f5933919-4b8b-4b8c-898b-559a0a883594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34fb06c8-a867-488b-ac9e-248a592c373a),volume_type_id=34fb06c8-a867-488b-ac9e-248a592c373a)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0cef43-2d75-4055-b612-9af1dbc10259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0cef43-2d75-4055-b612-9af1dbc10259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73c72aa-a137-4fc6-bfbd-6947bfd48d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73c72aa-a137-4fc6-bfbd-6947bfd48d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5933919-4b8b-4b8c-898b-559a0a883594', 'volume_name': 'volume-f5933919-4b8b-4b8c-898b-559a0a883594', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeca172-eb14-455b-8fc1-b3750a0fa178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeca172-eb14-455b-8fc1-b3750a0fa178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29b7508-b921-4c1c-af4b-52f02e51f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:24 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Volume f5933919-4b8b-4b8c-898b-559a0a883594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5933919-4b8b-4b8c-898b-559a0a883594', 'volume_size': 1} Sep 28 17:12:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-fe346ed9-cd90-4713-b2da-1612219e089e req-8405af91-46f6-46d8-b5de-168731f9df22 tempest-ServerActionsTestOtherA-1026857971 None] Terminate volume connection completed successfully. Sep 28 17:12:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-fe346ed9-cd90-4713-b2da-1612219e089e req-8405af91-46f6-46d8-b5de-168731f9df22 tempest-ServerActionsTestOtherA-1026857971 None] Deleting attachment f01f91ae-b3af-4659-9a7d-14ad16aa8bfb. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "cinder-e7f2b742-752f-4383-aae7-043d99f82a4a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-e7f2b742-752f-4383-aae7-043d99f82a4a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "cinder-quobyte-e7f2b742-752f-4383-aae7-043d99f82a4a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-quobyte-e7f2b742-752f-4383-aae7-043d99f82a4a" acquired by "delete_volume" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83c9460-c974-4b84-ba88-6c2661e64cdb]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:34 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a Sep 28 17:12:34 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786" returned: 0 in 11.518s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914, size 1024.00 MB, duration 11.52 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:12:35 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Converted 1024.00 MB image at 88.89 MB/s Sep 28 17:12:35 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 Sep 28 17:12:35 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a" returned: 0 in 1.044s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a Sep 28 17:12:35 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:35 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786" returned: 0 in 0.392s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" released by "_copy_volume_from_snapshot" :: held 13.065s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e7f2b742-752f-4383-aae7-043d99f82a4a" returned: 0 in 0.345s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-quobyte-e7f2b742-752f-4383-aae7-043d99f82a4a" released by "delete_volume" :: held 1.544s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2-ade5881c-7abb-4266-ba2a-3cd889123786" released by "_create_volume_from_snapshot" :: held 13.244s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.306s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.920s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7604b901-0f8e-477e-ba1e-0817ad96a302,created_at=2026-09-28T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1122378454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7604b901-0f8e-477e-ba1e-0817ad96a302,host='devstack@QuobyteHD#QuobyteHD',id=f5933919-4b8b-4b8c-898b-559a0a883594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0370537f157e4738aaf940883d9c95e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:25Z,use_quota=True,user_id='c133ffa65ea44dc1a676235349e71b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34fb06c8-a867-488b-ac9e-248a592c373a),volume_type_id=34fb06c8-a867-488b-ac9e-248a592c373a)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Creating volume f5933919-4b8b-4b8c-898b-559a0a883594 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:35 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:35 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 1073741824 Sep 28 17:12:35 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG cinder.quota [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Created reservations ['9b4768ce-7afa-4a26-a218-153914d7842c', '65387b57-c590-460c-835c-c03ebed9754a', '3e2f8cb3-5a73-4513-acce-cd470119114f', '39d17db0-5198-41a8-89fd-65936d44877d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d2d226c4-3aa0-410d-bdad-90417547a1f8 tempest-GroupSnapshotsTest-1150459424 None] Create group from source-snapshot-7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8 completed successfully. Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:36 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:36 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "cinder-7c5efa16-8281-4967-a66d-55b51bf416f4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-7c5efa16-8281-4967-a66d-55b51bf416f4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:36 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.655s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.manager [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "cinder-quobyte-7c5efa16-8281-4967-a66d-55b51bf416f4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Deleted volume successfully. Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-quobyte-7c5efa16-8281-4967-a66d-55b51bf416f4" acquired by "delete_volume" :: waited 0.045s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-fe346ed9-cd90-4713-b2da-1612219e089e req-4602ca46-6f34-4fc4-a1d6-f26fe7c41470 tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-e7f2b742-752f-4383-aae7-043d99f82a4a-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:37 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 1073741824" returned: 0 in 1.168s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a94ae-09db-4efa-9e85-c188422a37f5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 Sep 28 17:12:37 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 Sep 28 17:12:37 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:37 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29b7508-b921-4c1c-af4b-52f02e51f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5933919-4b8b-4b8c-898b-559a0a883594', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa627a25-9f5f-49c8-b76f-749dd6516a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:37 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Volume volume-f5933919-4b8b-4b8c-898b-559a0a883594 (f5933919-4b8b-4b8c-898b-559a0a883594): created successfully Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa627a25-9f5f-49c8-b76f-749dd6516a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Flow 'volume_create_manager' (d811c274-f9a1-4a70-84d3-7d66984261c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1190eeaf-39ee-4fff-b051-18aca6c7d985 tempest-GroupsTest-1964288719 None] Created volume successfully. Sep 28 17:12:37 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4" returned: 0 in 0.814s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:37 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4 Sep 28 17:12:37 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7c5efa16-8281-4967-a66d-55b51bf416f4" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-quobyte-7c5efa16-8281-4967-a66d-55b51bf416f4" released by "delete_volume" :: held 1.325s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=95,cinder:SELECT=80,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=74,cinder:INSERT=18,cinder:UPDATE=75,cinder:DELETE=3 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Created reservations ['08995ea5-8c05-4df3-b060-344889a0139f', '6b50ad3c-3193-47de-8225-5cf4d6e14ba0', '0065420f-00f0-4064-9f89-fad383c142cd', '79a13372-4a31-4ff8-84e3-eeccff6b12b5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[025c5528-845e-46fb-8c3e-e9c2da68b100]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:38 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:38 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 Sep 28 17:12:38 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:38 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.312s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:38 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Deleted volume successfully. Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2b43dc19-f237-4a9d-80ca-1a375a77dd1f tempest-ServerActionsTestOtherA-1026857971 None] Lock "cinder-7c5efa16-8281-4967-a66d-55b51bf416f4-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786" returned: 0 in 0.647s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786 Sep 28 17:12:39 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9426afd6-43a8-4137-a218-89f40576b3ba tempest-GroupsTest-1964288719 None] Update group completed successfully. Sep 28 17:12:39 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ade5881c-7abb-4266-ba2a-3cd889123786" returned: 0 in 0.542s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-ade5881c-7abb-4266-ba2a-3cd889123786" released by "delete_volume" :: held 1.270s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['f1246cd0-bec1-4b82-8700-3f3a0b2e2602'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:39 devstack cinder-volume[86929]: WARNING cinder.quota [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-65585321 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-65585321, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:39 devstack cinder-volume[86929]: WARNING cinder.quota [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-65585321 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-65585321, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:39 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['ea354b15-51be-4681-b767-037363325199', 'a252af18-7aec-4196-bf18-bd3e0880c338', '4850f95f-e87e-43fa-81a4-b1fbbe45c2c7', 'a0bfb878-7cd4-4690-bef0-8940b8a3a578'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:40 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.500s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d9b8bbf0-774a-4a0a-a1b1-8f46c61f57cb tempest-GroupSnapshotsTest-1150459424 None] Delete group completed successfully. Sep 28 17:12:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d624143c-335a-4117-bf18-38cc2bf665ff tempest-GroupsTest-1964288719 None] Update group completed successfully. Sep 28 17:12:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: deleting Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: deleting {{(pid=86929) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Deleting offline snapshot a77e957f-7b16-4aac-b314-6de759960ea2 of volume 520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] snapshot_file for this snap is: volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fd899-6596-423e-a89c-41008967f6df]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:41 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:41 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:42 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.653s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a76bd6-e470-4980-bb14-3ffd8cba2c4c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:42 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:42 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Acquiring lock "cinder-quobyte-ef5a2729-6772-48ef-b029-4a49a1e16be0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-ef5a2729-6772-48ef-b029-4a49a1e16be0" acquired by "delete_volume" :: waited 0.058s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f43a9-5297-49d4-9d74-dd3be9a371b6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 1.321s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:43 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 Sep 28 17:12:44 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0" returned: 0 in 0.733s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0 Sep 28 17:12:44 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.786s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2 Sep 28 17:12:44 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ef5a2729-6772-48ef-b029-4a49a1e16be0" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-ef5a2729-6772-48ef-b029-4a49a1e16be0" released by "delete_volume" :: held 1.274s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Acquiring lock "cinder-quobyte-f5933919-4b8b-4b8c-898b-559a0a883594" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-f5933919-4b8b-4b8c-898b-559a0a883594" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aaae77-f13d-4e25-9b24-9c719815e6b1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:45 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914.a77e957f-7b16-4aac-b314-6de759960ea2" returned: 0 in 0.468s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-a77e957f-7b16-4aac-b314-6de759960ea2" released by "_delete_snapshot" :: held 3.485s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:45 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 Sep 28 17:12:45 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" released by "delete_snapshot" :: held 3.562s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:45 devstack cinder-volume[86929]: WARNING cinder.quota [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-65585321 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-65585321, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['ea123faf-b1f3-4ef6-8266-0ee52e5994d7', '47412808-074d-439f-99a0-866488513b9f', '3bdd8995-d9e1-485f-bdb3-ef663b75d613', 'be0fd17b-9488-4f6f-b9af-dea9ab59ac36'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-257606a1-93fe-44fb-9589-5142c923fa47 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot 7f5671c9-dcde-4ec1-8fa7-301e8ddb91e8: deleted successfully Sep 28 17:12:45 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594" returned: 0 in 0.698s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:45 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594 Sep 28 17:12:45 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:46 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f5933919-4b8b-4b8c-898b-559a0a883594" returned: 0 in 0.392s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "cinder-quobyte-f5933919-4b8b-4b8c-898b-559a0a883594" released by "delete_volume" :: held 1.178s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Created reservations ['9a3e8957-540c-41fe-bd1b-5c6f7e46193c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:46 devstack cinder-volume[86929]: WARNING cinder.quota [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1852634910 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1852634910, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:46 devstack cinder-volume[86929]: WARNING cinder.quota [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1852634910 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1852634910, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Created reservations ['ad28f78c-e028-4cef-b9fd-bcb3a5a1bedb', '17889da6-0f00-48ea-9351-e5d8f7c2a0d4', '4a755e7e-2b35-4c44-9788-76fe95762c33', 'ed3c7fff-8414-486c-a2c6-d4e25a46d6e8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b648b-c150-4691-afcd-254439509c9d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Created reservations ['0e37f039-8669-4ce0-879a-d48a21b85510', 'd6c059c7-02ec-4b36-8617-127f62786889', '43ed6b10-be17-4a99-a0b2-4eed69655778', '8ca0ae07-ee1c-441a-8a17-94e99a272d87'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:46 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:46 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:46 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:46 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:47 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 0.611s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:47 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.328s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cf83aaf2-95fc-44e0-8241-54a34dc69b73 tempest-GroupsTest-1964288719 None] Delete group completed successfully. Sep 28 17:12:47 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914 Sep 28 17:12:47 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:47 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-520dc3ef-e5f4-46d2-a07e-fbefb2098914" returned: 0 in 0.293s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-520dc3ef-e5f4-46d2-a07e-fbefb2098914" released by "delete_volume" :: held 1.047s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['7cc99dc4-097c-4967-a027-c030ee954ed9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:47 devstack cinder-volume[86929]: WARNING cinder.db.api [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-65585321'] Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['d4befc73-22ec-4ecc-9840-bd57aad666ec', 'a075395c-b636-4f5b-8641-57f78d41f4d6', '57f46ae4-5bbd-4cbc-9a7f-b8082b5e9932', 'a3b7e34c-2537-409b-ae02-98f9b3f469d1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:47 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:47 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:48 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.360s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:48 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ebcea87e-4849-4873-9c28-81eacce68ae6 tempest-GroupSnapshotsTest-1150459424 None] Delete group completed successfully. Sep 28 17:12:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ca00b503-50e9-4bb7-a78f-d7fed359bf2e tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1981351536: creating Sep 28 17:12:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ca00b503-50e9-4bb7-a78f-d7fed359bf2e tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1981351536: created successfully Sep 28 17:12:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ca00b503-50e9-4bb7-a78f-d7fed359bf2e tempest-GroupSnapshotsTest-1150459424 None] Create group completed successfully. Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Flow 'volume_create_manager' (33e847c5-400b-4ecd-9ebb-a1360cbc249e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32dfee3-739a-4ce5-87ed-7b2f4e2d3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32dfee3-739a-4ce5-87ed-7b2f4e2d3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865782730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870614d0-91d7-4df3-ac05-3a838c3c7dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eba5aecfec4776a4683f618759ef14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:52Z,use_quota=True,user_id='c4b3b327a9ff4da4a58e7654e6975c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864295e1-65c6-4efd-89c5-bb46edf77671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864295e1-65c6-4efd-89c5-bb46edf77671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89f8fc1-754f-4644-93f0-cd7eeaaa3631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89f8fc1-754f-4644-93f0-cd7eeaaa3631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870614d0-91d7-4df3-ac05-3a838c3c7dbd', 'volume_name': 'volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d121875-ad6d-4c01-95fb-a64c0f780a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d121875-ad6d-4c01-95fb-a64c0f780a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039b62a5-ee02-44b5-a6ca-736077cb17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:51 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Volume 870614d0-91d7-4df3-ac05-3a838c3c7dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd', 'volume_size': 1} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-865782730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870614d0-91d7-4df3-ac05-3a838c3c7dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eba5aecfec4776a4683f618759ef14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:52Z,use_quota=True,user_id='c4b3b327a9ff4da4a58e7654e6975c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Creating volume 870614d0-91d7-4df3-ac05-3a838c3c7dbd {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:51 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:51 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd 1073741824 Sep 28 17:12:51 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (875d4886-f50c-4c0f-8478-aee52cd0b689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a201a-a84e-4153-90cf-c02a55c6fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96a201a-a84e-4153-90cf-c02a55c6fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748382930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=552e309a-09c1-4e91-bf5e-276112d5cf71,host='devstack@QuobyteHD#QuobyteHD',id=b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:52Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f37ea4-475e-4ea0-8fb3-f75326fac5fc),volume_type_id=a2f37ea4-475e-4ea0-8fb3-f75326fac5fc)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c059d814-2e00-43fa-9f3b-c1f3175012b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c059d814-2e00-43fa-9f3b-c1f3175012b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58597977-5329-4246-9a8d-35e61d3c232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58597977-5329-4246-9a8d-35e61d3c232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9', 'volume_name': 'volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b288bd7-2003-49a9-bd2d-99e9b9f459a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b288bd7-2003-49a9-bd2d-99e9b9f459a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e9fdb6-aae7-47b9-ae88-df6b734d6667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Volume b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9', 'volume_size': 1} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:52 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd 1073741824" returned: 0 in 0.947s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd Sep 28 17:12:52 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd" returned: 0 in 0.511s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=552e309a-09c1-4e91-bf5e-276112d5cf71,created_at=2026-09-28T15:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748382930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=552e309a-09c1-4e91-bf5e-276112d5cf71,host='devstack@QuobyteHD#QuobyteHD',id=b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:52Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f37ea4-475e-4ea0-8fb3-f75326fac5fc),volume_type_id=a2f37ea4-475e-4ea0-8fb3-f75326fac5fc)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Creating volume b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:53 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039b62a5-ee02-44b5-a6ca-736077cb17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 1073741824 Sep 28 17:12:53 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76750584-ec92-48b3-b897-49b4c3aef08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:53 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Volume volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd (870614d0-91d7-4df3-ac05-3a838c3c7dbd): created successfully Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76750584-ec92-48b3-b897-49b4c3aef08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Flow 'volume_create_manager' (33e847c5-400b-4ecd-9ebb-a1360cbc249e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:53 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c70807d2-e060-4bb7-b087-a031317674f5 tempest-VolumesTransfersV357Test-1753933566 None] Created volume successfully. Sep 28 17:12:54 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 1073741824" returned: 0 in 0.846s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:54 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 Sep 28 17:12:54 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:54 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e9fdb6-aae7-47b9-ae88-df6b734d6667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0285a04b-5ee1-40c5-8e68-90b8519f4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:54 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Volume volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 (b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9): created successfully Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0285a04b-5ee1-40c5-8e68-90b8519f4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (875d4886-f50c-4c0f-8478-aee52cd0b689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3342fef9-39d5-4017-b9e6-3c6ed1642f0d tempest-GroupSnapshotsTest-1150459424 None] Created volume successfully. Sep 28 17:12:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f5cd7e0d-3aa4-48c8-93fb-22925b5454d5 tempest-VolumesTransfersV357Test-1625554770 None] Transfer volume completed successfully. Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "cinder-870614d0-91d7-4df3-ac05-3a838c3c7dbd-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-870614d0-91d7-4df3-ac05-3a838c3c7dbd-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (4692b72b-550a-4702-a6ef-6c0617a973b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b1bb74-df82-45c7-a782-844b6f173961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "cinder-quobyte-870614d0-91d7-4df3-ac05-3a838c3c7dbd" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b1bb74-df82-45c7-a782-844b6f173961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129502775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=552e309a-09c1-4e91-bf5e-276112d5cf71,host='devstack@QuobyteHD#QuobyteHD',id=1ed9f5ee-e071-4dec-a9fd-71dabc916738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:57Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f37ea4-475e-4ea0-8fb3-f75326fac5fc),volume_type_id=a2f37ea4-475e-4ea0-8fb3-f75326fac5fc)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228eedd-188d-49f7-b01b-9e5e51cf0900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228eedd-188d-49f7-b01b-9e5e51cf0900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dfd350-6430-4f8a-a239-f113c5200deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dfd350-6430-4f8a-a239-f113c5200deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed9f5ee-e071-4dec-a9fd-71dabc916738', 'volume_name': 'volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3040cf0d-23ad-4ccb-8e22-b19e4e658590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3040cf0d-23ad-4ccb-8e22-b19e4e658590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be31cb-c189-4c53-b1fe-7e932db33fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Volume 1ed9f5ee-e071-4dec-a9fd-71dabc916738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738', 'volume_size': 1} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=552e309a-09c1-4e91-bf5e-276112d5cf71,created_at=2026-09-28T15:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1129502775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=552e309a-09c1-4e91-bf5e-276112d5cf71,host='devstack@QuobyteHD#QuobyteHD',id=1ed9f5ee-e071-4dec-a9fd-71dabc916738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:57Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2f37ea4-475e-4ea0-8fb3-f75326fac5fc),volume_type_id=a2f37ea4-475e-4ea0-8fb3-f75326fac5fc)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Creating volume 1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:57 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-quobyte-870614d0-91d7-4df3-ac05-3a838c3c7dbd" acquired by "delete_volume" :: waited 0.119s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:57 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 1073741824 Sep 28 17:12:57 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce0ced-da6c-44cf-b9f4-5cc805ecc98d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd Sep 28 17:12:58 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 1073741824" returned: 0 in 0.680s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd" returned: 0 in 0.633s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:58 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd Sep 28 17:12:58 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 Sep 28 17:12:58 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:58 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-870614d0-91d7-4df3-ac05-3a838c3c7dbd" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-quobyte-870614d0-91d7-4df3-ac05-3a838c3c7dbd" released by "delete_volume" :: held 1.207s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:58 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58be31cb-c189-4c53-b1fe-7e932db33fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5046fc5e-755b-4005-881e-9d38edee0a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Volume volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 (1ed9f5ee-e071-4dec-a9fd-71dabc916738): created successfully Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5046fc5e-755b-4005-881e-9d38edee0a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (4692b72b-550a-4702-a6ef-6c0617a973b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Created reservations ['4df2f2c4-9b14-41c4-ba83-e9b421703e99', '30344775-8354-47b0-a281-7c6f9587e31a', '90df3161-4e36-4c9e-a591-60d82292e51d', '32a9a780-7f3f-4cd5-86fa-3bac6eb2c3a5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d03a617e-db52-4331-a30b-05487986650f tempest-GroupSnapshotsTest-1150459424 None] Created volume successfully. Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:59 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:12:59 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:59 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.529s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Deleted volume successfully. Sep 28 17:12:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2465c103-09d1-4757-b205-62d44e9a4dd1 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-870614d0-91d7-4df3-ac05-3a838c3c7dbd-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fec3f205-9ef2-4904-8ba8-dbd9fac9d127 tempest-GroupSnapshotsTest-1150459424 None] Update group completed successfully. Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Flow 'volume_create_manager' (daeb2c88-85e8-47a7-94e8-134c17e396de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ae3050-2092-437b-8574-2a72c9f86833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ae3050-2092-437b-8574-2a72c9f86833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-35938077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb790d3f-1025-4878-8791-2f21e757e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eba5aecfec4776a4683f618759ef14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:01Z,use_quota=True,user_id='c4b3b327a9ff4da4a58e7654e6975c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39ede17-3dd7-4e20-928b-ef702b94ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39ede17-3dd7-4e20-928b-ef702b94ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37cae60-92da-4eeb-ac30-24e472687c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37cae60-92da-4eeb-ac30-24e472687c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb790d3f-1025-4878-8791-2f21e757e704', 'volume_name': 'volume-bb790d3f-1025-4878-8791-2f21e757e704', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39769d4d-e0ad-4213-a413-dcb92f7d076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39769d4d-e0ad-4213-a413-dcb92f7d076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6323f-5b63-4154-9747-2e9df200f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Volume bb790d3f-1025-4878-8791-2f21e757e704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb790d3f-1025-4878-8791-2f21e757e704', 'volume_size': 1} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-35938077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb790d3f-1025-4878-8791-2f21e757e704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eba5aecfec4776a4683f618759ef14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:01Z,use_quota=True,user_id='c4b3b327a9ff4da4a58e7654e6975c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Creating volume bb790d3f-1025-4878-8791-2f21e757e704 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:01 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:13:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:01 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 1073741824 Sep 28 17:13:01 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 1073741824" returned: 0 in 0.888s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b8ca970e-a50f-4d23-af46-07140d637d2a tempest-GroupSnapshotsTest-1150459424 None] Update group completed successfully. Sep 28 17:13:02 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 Sep 28 17:13:02 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:02 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6323f-5b63-4154-9747-2e9df200f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb790d3f-1025-4878-8791-2f21e757e704', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3344b-2d5d-40c5-94b5-cdb66a324c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Volume volume-bb790d3f-1025-4878-8791-2f21e757e704 (bb790d3f-1025-4878-8791-2f21e757e704): created successfully Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3344b-2d5d-40c5-94b5-cdb66a324c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Flow 'volume_create_manager' (daeb2c88-85e8-47a7-94e8-134c17e396de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a8fdf6b1-a362-4727-9d3e-159a46787696 tempest-VolumesTransfersV357Test-1753933566 None] Created volume successfully. Sep 28 17:13:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f81463e0-d028-46e0-9316-12b45ad058ad tempest-GroupSnapshotsTest-1150459424 None] Update group completed successfully. Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "cinder-bb790d3f-1025-4878-8791-2f21e757e704-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-bb790d3f-1025-4878-8791-2f21e757e704-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "cinder-quobyte-bb790d3f-1025-4878-8791-2f21e757e704" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-quobyte-bb790d3f-1025-4878-8791-2f21e757e704" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7cdaf-c7c0-4358-90c1-e63ddb3e013e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 Sep 28 17:13:04 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a9ede371-1999-4e0e-92ef-19a4aff516af tempest-GroupSnapshotsTest-1150459424 None] Update group completed successfully. Sep 28 17:13:05 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704" returned: 0 in 0.849s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704 Sep 28 17:13:05 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bb790d3f-1025-4878-8791-2f21e757e704" returned: 0 in 0.494s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-quobyte-bb790d3f-1025-4878-8791-2f21e757e704" released by "delete_volume" :: held 1.441s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:05 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Created reservations ['158e1901-e722-484c-9387-67502143e7f1', '43a42c47-df81-484e-a823-c3b7938bb595', '1a2b5f47-24f4-45e0-b53e-ee2070f073e5', '2259b01a-6dc4-4d20-83db-d3c4369a4896'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:13:06 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.627s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Deleted volume successfully. Sep 28 17:13:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e4c27ffe-88e9-4701-b471-0a8254b63490 tempest-VolumesTransfersV357Test-1217475396 None] Lock "cinder-bb790d3f-1025-4878-8791-2f21e757e704-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] GroupSnapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: creating. Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Group snapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: creating. {{(pid=86929) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Creating offline snapshot 136accea-7b80-444b-8a72-14a7d5072200 of volume 1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f532d1ea-ab11-4389-b4ab-d1f503037e78]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 Sep 28 17:13:07 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:13:07 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738" returned: 0 in 0.631s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 1G Sep 28 17:13:07 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:08 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.516s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:08 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 1G" returned: 0 in 0.981s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:08 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 Sep 28 17:13:08 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:09 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200" returned: 0 in 0.507s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:09 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 Sep 28 17:13:09 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:09 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200" returned: 0 in 0.485s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:09 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info Sep 28 17:13:09 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:10 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info" returned: 0 in 0.537s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:10 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:10 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info Sep 28 17:13:10 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:10 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.info" returned: 0 in 0.395s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.717s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Creating offline snapshot 7b03355e-d93c-4d80-a7f2-ddd69b37cecc of volume b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3935df59-0427-4ec1-bc74-afb17e36b86e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:11 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 Sep 28 17:13:11 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:11 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" returned: 0 in 0.642s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:11 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc 1G Sep 28 17:13:11 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:12 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc 1G" returned: 0 in 0.759s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:12 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc Sep 28 17:13:12 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:12 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc" returned: 0 in 0.573s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:12 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:12 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc Sep 28 17:13:12 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc" returned: 0 in 0.484s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info Sep 28 17:13:13 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info Sep 28 17:13:13 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.info" returned: 0 in 0.492s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.574s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:14 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1f6feec8-cd2f-4788-882d-1b19487af83f tempest-GroupSnapshotsTest-1150459424 None] group_snapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: created successfully Sep 28 17:13:14 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] group_snapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: deleting Sep 28 17:13:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] group_snapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: deleting {{(pid=86929) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-136accea-7b80-444b-8a72-14a7d5072200" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-136accea-7b80-444b-8a72-14a7d5072200" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Deleting offline snapshot 136accea-7b80-444b-8a72-14a7d5072200 of volume 1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] snapshot_file for this snap is: volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984bf47-24b1-432b-b208-8b5e52d4fdff]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:15 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 Sep 28 17:13:15 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:15 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200" returned: 0 in 0.642s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bafc9f-a15e-40b7-8bd1-aebb02ee1774]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 Sep 28 17:13:16 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738" returned: 0 in 0.562s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 Sep 28 17:13:16 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200" returned: 0 in 0.661s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200 Sep 28 17:13:17 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738.136accea-7b80-444b-8a72-14a7d5072200" returned: 0 in 0.435s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-136accea-7b80-444b-8a72-14a7d5072200" released by "_delete_snapshot" :: held 2.521s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" released by "delete_snapshot" :: held 2.564s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-7b03355e-d93c-4d80-a7f2-ddd69b37cecc" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-7b03355e-d93c-4d80-a7f2-ddd69b37cecc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Deleting offline snapshot 7b03355e-d93c-4d80-a7f2-ddd69b37cecc of volume b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] snapshot_file for this snap is: volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491f9f6-ef3b-4861-aa3d-cc68bc8b501c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc Sep 28 17:13:17 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc" returned: 0 in 0.531s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c0688-42f5-4528-9f65-6349d8f43a90]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 Sep 28 17:13:18 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" returned: 0 in 0.530s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc Sep 28 17:13:18 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc" returned: 0 in 0.506s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc Sep 28 17:13:19 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9.7b03355e-d93c-4d80-a7f2-ddd69b37cecc" returned: 0 in 0.447s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-7b03355e-d93c-4d80-a7f2-ddd69b37cecc" released by "_delete_snapshot" :: held 2.199s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" released by "delete_snapshot" :: held 2.236s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack cinder-volume[86929]: WARNING cinder.quota [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-112928502 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-112928502, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:20 devstack cinder-volume[86929]: WARNING cinder.quota [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-112928502 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-112928502, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:20 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['f3ba0c38-33e5-4efb-9ef9-5c7561492f61', '7487be49-2cfe-49af-92c1-ff2b54c6b650', 'e592e8d4-01fe-4ab5-a729-936f8e2a8763', '877d2f57-52bb-4320-b081-2e4588e7d946'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:20 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['bc204b13-96d3-4376-bfc2-48da8887c02c', '5c348a9b-e82a-4f0a-a9fd-6efce9fe6484', 'c215d86b-cb2c-4b08-9bce-9ef4daaf3966', '29ca320a-5e37-40b5-9b13-089cc38aac1d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c9769285-04f7-4ca3-a079-f89969c1750d tempest-GroupSnapshotsTest-1150459424 None] group_snapshot fd06f2eb-0f42-4ee5-bb77-249c258451e0: deleted successfully Sep 28 17:13:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:21 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bac2592-4433-485a-8472-4a9875a65ac8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 Sep 28 17:13:21 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738" returned: 0 in 0.582s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738 Sep 28 17:13:22 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ed9f5ee-e071-4dec-a9fd-71dabc916738" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-1ed9f5ee-e071-4dec-a9fd-71dabc916738" released by "delete_volume" :: held 1.182s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f73ef0-bba8-4675-9a4d-464ec6ac571a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 Sep 28 17:13:23 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" returned: 0 in 0.592s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:23 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9 Sep 28 17:13:23 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:23 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-b79d6ae9-31c6-4a94-8b37-5a53ad7b79e9" released by "delete_volume" :: held 1.170s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['146425ff-50a9-4d06-bb8f-872898818e69'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:24 devstack cinder-volume[86929]: WARNING cinder.quota [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-112928502 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-112928502, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['2ee4042a-b11c-4a87-93d5-cbaca5ab1b17', '7afb12e1-6a3d-4241-9538-56ba9e1b14af', '3c67c24d-704b-4a37-bc57-da1f7d67b473', '2593bf77-44c9-43c7-b9ee-e68c8bea996c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['42f9af43-d0db-4aed-b9b8-aeedb84f545d', 'cb550442-6f2b-4538-a676-2fa6a99054d7', '2c0b0ad1-a48c-4017-9b84-154acdeb4202', '36096363-fe4b-4a29-bf47-76c32a1cc6db'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:24 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:13:24 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:25 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.410s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-83999047-8f31-4689-ac55-f45a692b324a tempest-GroupSnapshotsTest-1150459424 None] Delete group completed successfully. Sep 28 17:13:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cc200199-297a-431a-977f-409ea41d5881 tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1279125363: creating Sep 28 17:13:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cc200199-297a-431a-977f-409ea41d5881 tempest-GroupSnapshotsTest-1150459424 None] Group tempest-GroupSnapshotsTest-Group-1279125363: created successfully Sep 28 17:13:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cc200199-297a-431a-977f-409ea41d5881 tempest-GroupSnapshotsTest-1150459424 None] Create group completed successfully. Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Flow 'volume_create_manager' (3c01eb46-9fc8-4c93-923d-230b85070a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab6e95-7f67-4f52-9025-b158be7d6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ab6e95-7f67-4f52-9025-b158be7d6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1955431316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284c54cd-2d43-474e-bb5b-aabd28ff2a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17bd66838d4522a7ae9741eaf5d647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='75208b530e09452eac4dcb8757219006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1d7f61-7682-4d5e-a2bf-7b73508e857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1d7f61-7682-4d5e-a2bf-7b73508e857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af72db81-f955-4e97-bc00-487d8566318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af72db81-f955-4e97-bc00-487d8566318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284c54cd-2d43-474e-bb5b-aabd28ff2a3c', 'volume_name': 'volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884cfb59-956f-4482-b220-bedcba67e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884cfb59-956f-4482-b220-bedcba67e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7362a9-ea4d-47f0-80a6-a68bef281f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:28 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Volume 284c54cd-2d43-474e-bb5b-aabd28ff2a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c', 'volume_size': 1} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1955431316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284c54cd-2d43-474e-bb5b-aabd28ff2a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c17bd66838d4522a7ae9741eaf5d647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:28Z,use_quota=True,user_id='75208b530e09452eac4dcb8757219006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Creating volume 284c54cd-2d43-474e-bb5b-aabd28ff2a3c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:28 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:13:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c 1073741824 Sep 28 17:13:28 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (7d7e3ae9-6a05-45de-a18b-e86878ed8c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cb47db-96f2-4adc-ad86-808f25307f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cb47db-96f2-4adc-ad86-808f25307f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933817978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d08ffc-9b63-4cf3-bd21-d6e5c07db01c,host='devstack@QuobyteHD#QuobyteHD',id=541cff6e-c160-47cf-ba5c-8be88b3e8d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:29Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3342e4a9-1de1-4676-b298-5c45514f2392),volume_type_id=3342e4a9-1de1-4676-b298-5c45514f2392)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a5ffe6-27bb-45e8-a105-c44469e024c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a5ffe6-27bb-45e8-a105-c44469e024c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98cf052-f4ba-4811-a091-bbed4fa221ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98cf052-f4ba-4811-a091-bbed4fa221ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541cff6e-c160-47cf-ba5c-8be88b3e8d8f', 'volume_name': 'volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfad06e-e227-4012-99ba-bc7eeca81f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfad06e-e227-4012-99ba-bc7eeca81f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa04725-8357-4a53-a4e6-3ff8a889dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Volume 541cff6e-c160-47cf-ba5c-8be88b3e8d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f', 'volume_size': 1} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:29 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c 1073741824" returned: 0 in 1.173s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c Sep 28 17:13:29 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08d08ffc-9b63-4cf3-bd21-d6e5c07db01c,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933817978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08d08ffc-9b63-4cf3-bd21-d6e5c07db01c,host='devstack@QuobyteHD#QuobyteHD',id=541cff6e-c160-47cf-ba5c-8be88b3e8d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='515bec5a5bc24079b0171a9c1c7421ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:29Z,use_quota=True,user_id='9c1c4794554e45299f1a6058ece2766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3342e4a9-1de1-4676-b298-5c45514f2392),volume_type_id=3342e4a9-1de1-4676-b298-5c45514f2392)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Creating volume 541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:30 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f 1073741824 Sep 28 17:13:30 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7362a9-ea4d-47f0-80a6-a68bef281f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd09d6-404d-4e6a-ae84-75376f07640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:30 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Volume volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c (284c54cd-2d43-474e-bb5b-aabd28ff2a3c): created successfully Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd09d6-404d-4e6a-ae84-75376f07640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Flow 'volume_create_manager' (3c01eb46-9fc8-4c93-923d-230b85070a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7e09f49d-3ce6-40d1-a21a-0d4345f34a09 tempest-VolumesServicesTestJSON-1917806590 None] Created volume successfully. Sep 28 17:13:31 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f 1073741824" returned: 0 in 1.134s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f Sep 28 17:13:31 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:31 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" returned: 0 in 0.454s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Acquiring lock "cinder-284c54cd-2d43-474e-bb5b-aabd28ff2a3c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa04725-8357-4a53-a4e6-3ff8a889dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa6770-c911-4767-b72e-7a92a9605e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Volume volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f (541cff6e-c160-47cf-ba5c-8be88b3e8d8f): created successfully Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caa6770-c911-4767-b72e-7a92a9605e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Flow 'volume_create_manager' (7d7e3ae9-6a05-45de-a18b-e86878ed8c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "cinder-284c54cd-2d43-474e-bb5b-aabd28ff2a3c-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:32 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c716cc62-82c9-45ad-92d6-d1339241be2b tempest-GroupSnapshotsTest-1150459424 None] Created volume successfully. Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Acquiring lock "cinder-quobyte-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "cinder-quobyte-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8448c9d1-1737-46bd-ba9d-30f10421d9b2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c Sep 28 17:13:32 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c Sep 28 17:13:32 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" returned: 0 in 0.439s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "cinder-quobyte-284c54cd-2d43-474e-bb5b-aabd28ff2a3c" released by "delete_volume" :: held 1.112s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Created reservations ['a166bb7b-5933-4c89-88cc-12bc8ed89555', '77f634df-8e81-4ed2-8dab-b68877eacc64', 'a5569ff4-bebf-4215-9e7f-9aaaf992be0e', '33a4e74d-64e8-4d4a-86eb-b9b24192d1e6'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:13:33 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] GroupSnapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: creating. Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Group snapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: creating. {{(pid=86929) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Creating offline snapshot cd801470-d021-4d7b-a8cd-555bf5b27f9c of volume 541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b5d76-c000-40a0-8c04-313e87922656]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.572s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:34 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f Sep 28 17:13:34 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Deleted volume successfully. Sep 28 17:13:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e3c03214-8028-4865-8e20-036313ebbe07 tempest-VolumesServicesTestJSON-1917806590 None] Lock "cinder-284c54cd-2d43-474e-bb5b-aabd28ff2a3c-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:34 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" returned: 0 in 0.737s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c 1G Sep 28 17:13:34 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c 1G" returned: 0 in 0.791s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c Sep 28 17:13:35 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c" returned: 0 in 0.748s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:36 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c Sep 28 17:13:36 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c" returned: 0 in 0.639s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info Sep 28 17:13:37 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info" returned: 0 in 0.654s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info Sep 28 17:13:37 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.info" returned: 0 in 0.568s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.369s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:INSERT=35,cinder:UPDATE=139,cinder:SELECT=117,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=125,cinder:INSERT=30,cinder:UPDATE=140,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4c1a5e4f-abea-41e4-916c-274d9e4b3799 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: created successfully Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Flow 'volume_create_manager' (9d7b5dac-64a2-434b-88e2-42dfdda0e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedde4ec-3e76-4f2d-8119-efafa456ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedde4ec-3e76-4f2d-8119-efafa456ee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-670756304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd47c525-ed31-4ed3-b9c7-7255a8d90668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef810fb2fea347f1bba052290b4ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:40Z,use_quota=True,user_id='0704bd716dd740aaa71b4daa8190a9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d5e902-2531-481c-8385-a44dc54dddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d5e902-2531-481c-8385-a44dc54dddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1aac18b-af4e-49e1-9d18-1ec12c0ae156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1aac18b-af4e-49e1-9d18-1ec12c0ae156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd47c525-ed31-4ed3-b9c7-7255a8d90668', 'volume_name': 'volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2763e-47e9-4c4a-bcd7-a0178682ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac2763e-47e9-4c4a-bcd7-a0178682ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c06d46c-7642-4361-ad5f-85416f2ff6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Volume bd47c525-ed31-4ed3-b9c7-7255a8d90668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668', 'volume_size': 1} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-670756304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd47c525-ed31-4ed3-b9c7-7255a8d90668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef810fb2fea347f1bba052290b4ec82a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:40Z,use_quota=True,user_id='0704bd716dd740aaa71b4daa8190a9ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Creating volume bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:40 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 1073741824 Sep 28 17:13:40 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: deleting Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: deleting {{(pid=86929) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-cd801470-d021-4d7b-a8cd-555bf5b27f9c" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-cd801470-d021-4d7b-a8cd-555bf5b27f9c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Deleting offline snapshot cd801470-d021-4d7b-a8cd-555bf5b27f9c of volume 541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] snapshot_file for this snap is: volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec625bf-a54e-4510-bb9b-95eede3c46c1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c Sep 28 17:13:40 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 1073741824" returned: 0 in 1.004s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:13:41 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c" returned: 0 in 0.750s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8271278a-93a0-44e3-b760-a03b22a57db8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:41 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f Sep 28 17:13:41 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.605s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c06d46c-7642-4361-ad5f-85416f2ff6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49552f85-6b98-406b-8f5e-2814c0a954f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Volume volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 (bd47c525-ed31-4ed3-b9c7-7255a8d90668): created successfully Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49552f85-6b98-406b-8f5e-2814c0a954f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Flow 'volume_create_manager' (9d7b5dac-64a2-434b-88e2-42dfdda0e593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d37b760c-18bb-4bef-9832-25c364a7ba9e tempest-VolumesActionsTest-1484647135 None] Created volume successfully. Sep 28 17:13:42 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" returned: 0 in 0.957s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c Sep 28 17:13:42 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c" returned: 0 in 0.765s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c Sep 28 17:13:43 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f.cd801470-d021-4d7b-a8cd-555bf5b27f9c" returned: 0 in 0.531s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-cd801470-d021-4d7b-a8cd-555bf5b27f9c" released by "_delete_snapshot" :: held 3.269s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" released by "delete_snapshot" :: held 3.314s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:43 devstack cinder-volume[86929]: WARNING cinder.quota [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-698552678 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-698552678, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:43 devstack cinder-volume[86929]: WARNING cinder.quota [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-698552678 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-698552678, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['8a60fa81-5562-4db3-b71a-863bc909fe83', '92e60b8b-a98c-4c42-9f89-278c25ae7965', 'd4514f07-1193-4084-a9fb-99cde2168419', 'd9c02086-aefb-4f24-9d36-4aa2780a78c1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-56d911a8-2359-4115-88d5-f88eb7d5d784 tempest-GroupSnapshotsTest-1150459424 None] group_snapshot e5d9db43-bc20-4a12-a669-45ae21419ae8: deleted successfully Sep 28 17:13:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872f8a3-9960-4f88-8c3c-8ecf52b6df1d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f Sep 28 17:13:46 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Flow 'volume_create_manager' (bb48f70c-c188-4cd4-8ac0-7b14624a4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:47 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa0047-dcb1-4069-acb0-07f4d9132508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" returned: 0 in 0.857s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fa0047-dcb1-4069-acb0-07f4d9132508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-200965562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e352e-b4d3-4755-906e-8102dce38790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211fd2e2d51d441999e5c85892ad2f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:47Z,use_quota=True,user_id='b6d6ba48061f4790b9007c2c0c122ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:47 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f Sep 28 17:13:47 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef5b102-ca63-47e5-ae00-18e33e94bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ef5b102-ca63-47e5-ae00-18e33e94bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b433d52-407f-4e7c-acd1-8715a1db0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b433d52-407f-4e7c-acd1-8715a1db0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3e352e-b4d3-4755-906e-8102dce38790', 'volume_name': 'volume-6d3e352e-b4d3-4755-906e-8102dce38790', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1fc1d7-75ff-4037-af8f-5e7c0aa445aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1fc1d7-75ff-4037-af8f-5e7c0aa445aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990fdea7-3ef3-42e3-89ce-1d943263a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Volume 6d3e352e-b4d3-4755-906e-8102dce38790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3e352e-b4d3-4755-906e-8102dce38790', 'volume_size': 1} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-200965562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3e352e-b4d3-4755-906e-8102dce38790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211fd2e2d51d441999e5c85892ad2f85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:47Z,use_quota=True,user_id='b6d6ba48061f4790b9007c2c0c122ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Creating volume 6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:47 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 1073741824 Sep 28 17:13:47 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" returned: 0 in 0.563s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Lock "cinder-quobyte-541cff6e-c160-47cf-ba5c-8be88b3e8d8f" released by "delete_volume" :: held 1.730s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['e8ddd854-4f98-4099-aac5-60d1d4be1550'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:48 devstack cinder-volume[86929]: WARNING cinder.quota [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-698552678 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-698552678, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Created reservations ['7dbe5422-fb3e-4b8f-91da-df8d09d05191', '33175819-7c00-42ea-8715-f50ae0e0c8ef', 'fa10e853-94d4-4a09-b4d1-93990c3f1c6e', 'ff8d8d87-44a3-4b95-b35e-9be347a6b17d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:48 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 1073741824" returned: 0 in 1.126s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:13:48 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 Sep 28 17:13:48 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.498s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-01d71510-f5f5-497f-abc6-59d5d3f52469 tempest-GroupSnapshotsTest-1150459424 None] Delete group completed successfully. Sep 28 17:13:49 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790" returned: 0 in 0.713s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990fdea7-3ef3-42e3-89ce-1d943263a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3e352e-b4d3-4755-906e-8102dce38790', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de62356-c30f-4766-9033-3c7470d5fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Volume volume-6d3e352e-b4d3-4755-906e-8102dce38790 (6d3e352e-b4d3-4755-906e-8102dce38790): created successfully Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de62356-c30f-4766-9033-3c7470d5fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Flow 'volume_create_manager' (bb48f70c-c188-4cd4-8ac0-7b14624a4968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c3a4a598-77e9-4353-a6d9-53a45939715c tempest-SnapshotMetadataTestJSON-1281355070 None] Created volume successfully. Sep 28 17:13:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Creating offline snapshot 3c342b64-19e6-492e-83ee-956b1296cc58 of volume 6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80776b-bc3e-410c-b125-df52c3853cc0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 Sep 28 17:13:51 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:51 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790" returned: 0 in 0.562s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 1G Sep 28 17:13:51 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:52 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 1G" returned: 0 in 0.729s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3e352e-b4d3-4755-906e-8102dce38790 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3e352e-b4d3-4755-906e-8102dce38790 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 Sep 28 17:13:52 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:52 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3e352e-b4d3-4755-906e-8102dce38790 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58" returned: 0 in 0.571s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:52 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 is being set with open permissions: ugo+rw Sep 28 17:13:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 Sep 28 17:13:52 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:53 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58" returned: 0 in 0.405s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:53 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info Sep 28 17:13:53 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:54 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info" returned: 0 in 0.945s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:54 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info is being set with open permissions: ugo+rw Sep 28 17:13:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:54 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info Sep 28 17:13:54 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:55 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.info" returned: 0 in 1.044s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5d0da43f-dbd0-4007-8060-de4db6aaa4ba tempest-SnapshotMetadataTestJSON-1281355070 None] Create snapshot completed successfully Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "cinder-3c342b64-19e6-492e-83ee-956b1296cc58-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-3c342b64-19e6-492e-83ee-956b1296cc58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "cinder-quobyte-3c342b64-19e6-492e-83ee-956b1296cc58" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-3c342b64-19e6-492e-83ee-956b1296cc58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Deleting offline snapshot 3c342b64-19e6-492e-83ee-956b1296cc58 of volume 6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] snapshot_file for this snap is: volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dae9d3-6360-45e7-b94a-a5710166880f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 Sep 28 17:13:58 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:58 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58" returned: 0 in 0.499s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3e352e-b4d3-4755-906e-8102dce38790(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f45cce3-9318-4f16-be78-a1bd3a236d39]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 Sep 28 17:13:59 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790" returned: 0 in 0.681s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6f67e92a-2bdb-46f0-a288-0b68b022cbd0 tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" by "attach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:59 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 Sep 28 17:13:59 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6f67e92a-2bdb-46f0-a288-0b68b022cbd0 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" acquired by "attach_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6f67e92a-2bdb-46f0-a288-0b68b022cbd0 tempest-VolumesActionsTest-1484647135 None] Attaching volume bd47c525-ed31-4ed3-b9c7-7255a8d90668 to instance cd2d22d0-abcd-48ce-ab52-f9f3ca86067a at mountpoint /dev/vdb on host None. Sep 28 17:13:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6f67e92a-2bdb-46f0-a288-0b68b022cbd0 tempest-VolumesActionsTest-1484647135 None] Attach volume completed successfully. Sep 28 17:13:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6f67e92a-2bdb-46f0-a288-0b68b022cbd0 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" released by "attach_volume" :: held 0.210s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f2b05c4-9b55-40a4-aa8b-a5a7848fa2cd tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" by "detach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f2b05c4-9b55-40a4-aa8b-a5a7848fa2cd tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9f2b05c4-9b55-40a4-aa8b-a5a7848fa2cd tempest-VolumesActionsTest-1484647135 None] Detaching volume bd47c525-ed31-4ed3-b9c7-7255a8d90668 from instance cd2d22d0-abcd-48ce-ab52-f9f3ca86067a. Sep 28 17:14:00 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58" returned: 0 in 0.701s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9f2b05c4-9b55-40a4-aa8b-a5a7848fa2cd tempest-VolumesActionsTest-1484647135 None] Detach volume completed successfully. Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f2b05c4-9b55-40a4-aa8b-a5a7848fa2cd tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" released by "detach_volume" :: held 0.206s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:00 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58 Sep 28 17:14:00 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790.3c342b64-19e6-492e-83ee-956b1296cc58" returned: 0 in 0.496s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-3c342b64-19e6-492e-83ee-956b1296cc58" released by "_delete_snapshot" :: held 2.635s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" released by "delete_snapshot" :: held 2.666s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Created reservations ['3cd81b0c-d7a8-4533-94ff-d0172bb4162b', 'd62a0925-912a-47ac-ab60-52c23dfe8eda', 'efbae162-8ab5-46d3-a9c4-f58c6e62ed39', '60b222cf-c25e-4446-bba8-a086eccde5e1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Delete snapshot completed successfully. Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7d97fd55-2f32-4986-8255-46179a824dcb tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-3c342b64-19e6-492e-83ee-956b1296cc58-delete_snapshot" released by "delete_snapshot" :: held 2.892s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "cinder-6d3e352e-b4d3-4755-906e-8102dce38790-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-6d3e352e-b4d3-4755-906e-8102dce38790-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9618639f-0060-46c0-bd03-aa9abbbb7c28]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 Sep 28 17:14:02 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ef1c8f88-f703-4d15-8f7d-5a8309433147 tempest-GroupSnapshotsV319Test-191098172 None] Group tempest-GroupSnapshotsV319Test-Group-1308296771: creating Sep 28 17:14:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ef1c8f88-f703-4d15-8f7d-5a8309433147 tempest-GroupSnapshotsV319Test-191098172 None] Group tempest-GroupSnapshotsV319Test-Group-1308296771: created successfully Sep 28 17:14:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ef1c8f88-f703-4d15-8f7d-5a8309433147 tempest-GroupSnapshotsV319Test-191098172 None] Create group completed successfully. Sep 28 17:14:02 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790" returned: 0 in 0.745s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790 Sep 28 17:14:02 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d3e352e-b4d3-4755-906e-8102dce38790" returned: 0 in 0.474s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-quobyte-6d3e352e-b4d3-4755-906e-8102dce38790" released by "delete_volume" :: held 1.374s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Created reservations ['bacaabce-0735-4b5f-a360-56cabb754968', 'd3d9ab09-47ef-4f31-abaa-4f9acfb38f56', '2fa13677-2cb5-4873-a1b9-a89fb022a9c1', '8b72a9a7-9910-4f95-a74b-835c426fe9cd'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:14:03 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.471s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Deleted volume successfully. Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aefc9844-f43b-4d65-9747-f77b23e3c1ad tempest-SnapshotMetadataTestJSON-1281355070 None] Lock "cinder-6d3e352e-b4d3-4755-906e-8102dce38790-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Flow 'volume_create_manager' (e80b537c-32b7-4045-9178-0832c8ab5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae913400-cfda-49d1-8024-f38f4eb8a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae913400-cfda-49d1-8024-f38f4eb8a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581570728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c31acd69-c5c8-429c-990d-695ca0abdd57,host='devstack@QuobyteHD#QuobyteHD',id=26c819d2-a1c9-494f-b1f0-567c32408d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef16a0525c2e489f8074ef6041c1f9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:05Z,use_quota=True,user_id='0ba25f1ef2274a17a48bac527f61d491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9b4d38-9a61-4290-af2b-e0e13515d197),volume_type_id=3f9b4d38-9a61-4290-af2b-e0e13515d197)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef5ee90-d6d2-4d6e-97ed-7add2abaa0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef5ee90-d6d2-4d6e-97ed-7add2abaa0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fda0eff-a064-4861-9598-f5cfaa93bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fda0eff-a064-4861-9598-f5cfaa93bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c819d2-a1c9-494f-b1f0-567c32408d1c', 'volume_name': 'volume-26c819d2-a1c9-494f-b1f0-567c32408d1c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb2eaf0-d82b-4e5f-926e-c6badd33bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb2eaf0-d82b-4e5f-926e-c6badd33bb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd672f36-0c04-4449-81fa-fb5ba66b0295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:04 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Volume 26c819d2-a1c9-494f-b1f0-567c32408d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c819d2-a1c9-494f-b1f0-567c32408d1c', 'volume_size': 1} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c31acd69-c5c8-429c-990d-695ca0abdd57,created_at=2026-09-28T15:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1581570728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c31acd69-c5c8-429c-990d-695ca0abdd57,host='devstack@QuobyteHD#QuobyteHD',id=26c819d2-a1c9-494f-b1f0-567c32408d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef16a0525c2e489f8074ef6041c1f9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:05Z,use_quota=True,user_id='0ba25f1ef2274a17a48bac527f61d491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9b4d38-9a61-4290-af2b-e0e13515d197),volume_type_id=3f9b4d38-9a61-4290-af2b-e0e13515d197)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Creating volume 26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:04 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:14:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c 1073741824 Sep 28 17:14:04 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c 1073741824" returned: 0 in 0.628s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c Sep 28 17:14:05 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c" returned: 0 in 0.490s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd672f36-0c04-4449-81fa-fb5ba66b0295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c819d2-a1c9-494f-b1f0-567c32408d1c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7f0af7-e51f-4f5c-8d88-7b248a5d4d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Volume volume-26c819d2-a1c9-494f-b1f0-567c32408d1c (26c819d2-a1c9-494f-b1f0-567c32408d1c): created successfully Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7f0af7-e51f-4f5c-8d88-7b248a5d4d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Flow 'volume_create_manager' (e80b537c-32b7-4045-9178-0832c8ab5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3f2ea236-6619-419e-8a6b-46efa116ac87 tempest-GroupSnapshotsV319Test-191098172 None] Created volume successfully. Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:14:07 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] GroupSnapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: creating. Sep 28 17:14:08 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Group snapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: creating. {{(pid=86929) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.543s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Creating offline snapshot 10bf6935-1d4d-4cff-845f-5ab39d2726d2 of volume 26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c985bdd8-037a-49f3-ba86-e88307547d5d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Flow 'volume_create_manager' (9bc2d78a-5811-4642-862b-a9e7f3731321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9396cdb0-c050-45f5-a20b-7d31e7ec0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9396cdb0-c050-45f5-a20b-7d31e7ec0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-373964935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7b8877-9063-4002-a2ab-b807ef376b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5644d579976a47fd994e633d3d180f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:08Z,use_quota=True,user_id='2fbba323b8d94e39b343c1488487aae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897d8664-5df7-46db-a4c0-14e9dc24be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897d8664-5df7-46db-a4c0-14e9dc24be1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b890f32-fd31-47a2-a31c-ef696de5fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b890f32-fd31-47a2-a31c-ef696de5fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7b8877-9063-4002-a2ab-b807ef376b93', 'volume_name': 'volume-be7b8877-9063-4002-a2ab-b807ef376b93', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c54b6-300a-4ed3-b87f-90523c89e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c54b6-300a-4ed3-b87f-90523c89e987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37338de0-f7d1-4fa0-8389-95be2a641788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:08 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Volume be7b8877-9063-4002-a2ab-b807ef376b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7b8877-9063-4002-a2ab-b807ef376b93', 'volume_size': 1} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:08 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c Sep 28 17:14:08 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c" returned: 0 in 0.729s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 1G Sep 28 17:14:08 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 1G" returned: 0 in 0.717s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c819d2-a1c9-494f-b1f0-567c32408d1c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:09 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c819d2-a1c9-494f-b1f0-567c32408d1c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 Sep 28 17:14:09 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c819d2-a1c9-494f-b1f0-567c32408d1c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2" returned: 0 in 0.443s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 Sep 28 17:14:10 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2" returned: 0 in 0.344s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info Sep 28 17:14:10 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info" returned: 0 in 0.365s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:14:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info Sep 28 17:14:10 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.info" returned: 0 in 0.394s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.820s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-373964935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7b8877-9063-4002-a2ab-b807ef376b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5644d579976a47fd994e633d3d180f5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:08Z,use_quota=True,user_id='2fbba323b8d94e39b343c1488487aae4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Creating volume be7b8877-9063-4002-a2ab-b807ef376b93 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:11 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:14:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 1073741824 Sep 28 17:14:11 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6df350f8-c9df-4f4c-9e28-e24ebbb9f370 tempest-GroupSnapshotsV319Test-191098172 None] group_snapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: created successfully Sep 28 17:14:12 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 1073741824" returned: 0 in 0.952s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 Sep 28 17:14:12 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93" returned: 0 in 0.554s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37338de0-f7d1-4fa0-8389-95be2a641788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7b8877-9063-4002-a2ab-b807ef376b93', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e006e2-3400-443c-b8b7-3921b03ca3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:13 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Volume volume-be7b8877-9063-4002-a2ab-b807ef376b93 (be7b8877-9063-4002-a2ab-b807ef376b93): created successfully Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e006e2-3400-443c-b8b7-3921b03ca3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Flow 'volume_create_manager' (9bc2d78a-5811-4642-862b-a9e7f3731321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:13 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-21c5f4a1-e938-43cd-8702-876cc95e14ee tempest-AttachVolumeShelveTestJSON-690341656 None] Created volume successfully. Sep 28 17:14:13 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] group_snapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: deleting Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] group_snapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: deleting {{(pid=86929) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "cinder-quobyte-10bf6935-1d4d-4cff-845f-5ab39d2726d2" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-10bf6935-1d4d-4cff-845f-5ab39d2726d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Deleting offline snapshot 10bf6935-1d4d-4cff-845f-5ab39d2726d2 of volume 26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] snapshot_file for this snap is: volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac52c9c-d1cc-462e-93b4-d746324c0143]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 Sep 28 17:14:13 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:14 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Flow 'volume_create_manager' (1acc707d-1212-4f9a-8949-2fcfa226a0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869d0624-0125-4782-bdb6-a115e8956511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2" returned: 0 in 0.809s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c819d2-a1c9-494f-b1f0-567c32408d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869d0624-0125-4782-bdb6-a115e8956511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1502589977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dd5ce1-14ad-4d99-ac68-5273fff29623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e481a5ddc74e8da338a64a3e63d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:14Z,use_quota=True,user_id='e939019b959842daa2ca153fec0f353a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033436f5-564f-4aef-91bd-c8dfedded5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033436f5-564f-4aef-91bd-c8dfedded5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7982ef5d-b87c-4ae5-806a-0f74eb147c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7982ef5d-b87c-4ae5-806a-0f74eb147c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98dd5ce1-14ad-4d99-ac68-5273fff29623', 'volume_name': 'volume-98dd5ce1-14ad-4d99-ac68-5273fff29623', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da01d10-251d-41aa-baea-4e68b29e502f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da01d10-251d-41aa-baea-4e68b29e502f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b39572-0a0b-4203-92d5-fdeb0578514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:14 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Volume 98dd5ce1-14ad-4d99-ac68-5273fff29623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98dd5ce1-14ad-4d99-ac68-5273fff29623', 'volume_size': 1} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1502589977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dd5ce1-14ad-4d99-ac68-5273fff29623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e481a5ddc74e8da338a64a3e63d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:14Z,use_quota=True,user_id='e939019b959842daa2ca153fec0f353a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Creating volume 98dd5ce1-14ad-4d99-ac68-5273fff29623 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:14 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f7a74a-56d4-401f-a73c-f2fe33dd9afc]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 1073741824 Sep 28 17:14:14 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c Sep 28 17:14:14 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c" returned: 0 in 0.604s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 Sep 28 17:14:15 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 1073741824" returned: 0 in 0.877s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 Sep 28 17:14:15 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2" returned: 0 in 0.628s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2 Sep 28 17:14:15 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623" returned: 0 in 0.408s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b39572-0a0b-4203-92d5-fdeb0578514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98dd5ce1-14ad-4d99-ac68-5273fff29623', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad5ae8-35ff-4dd5-8517-f347a8101495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Volume volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 (98dd5ce1-14ad-4d99-ac68-5273fff29623): created successfully Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cad5ae8-35ff-4dd5-8517-f347a8101495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Flow 'volume_create_manager' (1acc707d-1212-4f9a-8949-2fcfa226a0a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0e962b8b-e743-43eb-8fa5-7e06461bea00 tempest-VolumesTransfersTest-681853264 None] Created volume successfully. Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9274ad24-7997-4cd7-b4d2-412dba36ec6a tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" by "attach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9274ad24-7997-4cd7-b4d2-412dba36ec6a tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" acquired by "attach_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:16 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c.10bf6935-1d4d-4cff-845f-5ab39d2726d2" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-10bf6935-1d4d-4cff-845f-5ab39d2726d2" released by "_delete_snapshot" :: held 2.717s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9274ad24-7997-4cd7-b4d2-412dba36ec6a tempest-VolumesActionsTest-1484647135 None] Attaching volume bd47c525-ed31-4ed3-b9c7-7255a8d90668 to instance b7127d30-0c5f-4e32-b701-704515496ea3 at mountpoint /dev/vdb on host None. Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" released by "delete_snapshot" :: held 2.764s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9274ad24-7997-4cd7-b4d2-412dba36ec6a tempest-VolumesActionsTest-1484647135 None] Attach volume completed successfully. Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9274ad24-7997-4cd7-b4d2-412dba36ec6a tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668" released by "attach_volume" :: held 0.273s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-473240836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-473240836, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-473240836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-473240836, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:16 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] Created reservations ['e0234517-1345-4ca2-832e-c4d83e78c355', 'c05e49fc-a1d2-4ea1-aaf4-887da7697aa5', 'ed39bd5c-257c-4b16-a64d-fcfb33acd94b', '9d7eb218-f8ef-4749-8766-3559c194d5f5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0239500c-cc7d-460f-9556-1d4f49397e05 tempest-GroupSnapshotsV319Test-191098172 None] group_snapshot 94a5b816-f0e6-4ff6-9271-823ef88c38d3: deleted successfully Sep 28 17:14:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e57891dc-6642-44e8-bb9a-261c36d9adca tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" by "detach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e57891dc-6642-44e8-bb9a-261c36d9adca tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e57891dc-6642-44e8-bb9a-261c36d9adca tempest-VolumesActionsTest-1484647135 None] Detaching volume bd47c525-ed31-4ed3-b9c7-7255a8d90668 from instance b7127d30-0c5f-4e32-b701-704515496ea3. Sep 28 17:14:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e57891dc-6642-44e8-bb9a-261c36d9adca tempest-VolumesActionsTest-1484647135 None] Detach volume completed successfully. Sep 28 17:14:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e57891dc-6642-44e8-bb9a-261c36d9adca tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:18 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b00b014f-94da-483f-9410-6c03a7b85764 tempest-VolumesTransfersTest-132975875 None] Transfer volume completed successfully. Sep 28 17:14:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" acquired by "delete_volume" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb895cf-dc59-44bb-9e88-56d8de73d567]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c Sep 28 17:14:18 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c" returned: 0 in 0.797s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c Sep 28 17:14:19 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "cinder-98dd5ce1-14ad-4d99-ac68-5273fff29623-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-98dd5ce1-14ad-4d99-ac68-5273fff29623-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "cinder-quobyte-98dd5ce1-14ad-4d99-ac68-5273fff29623" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-quobyte-98dd5ce1-14ad-4d99-ac68-5273fff29623" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2115f87-188e-4639-a803-7981de8a0b74]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-26c819d2-a1c9-494f-b1f0-567c32408d1c" returned: 0 in 0.394s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Lock "cinder-quobyte-26c819d2-a1c9-494f-b1f0-567c32408d1c" released by "delete_volume" :: held 1.381s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 Sep 28 17:14:19 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Created reservations ['2e414be5-b568-40ab-a7db-2e53de067c66'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:19 devstack cinder-volume[86929]: WARNING cinder.quota [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-473240836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-473240836, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Created reservations ['b53e5e7b-2343-4829-b01b-eabf594bef64', '335d4dd4-ebb2-4bee-be0b-a640c4ac9506', '1ec6f2e1-1224-4c4f-b377-7c36d47c7f4d', '2eeca84f-396d-4db5-bb48-c6695ff698c3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:20 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623" returned: 0 in 0.669s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:20 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623 Sep 28 17:14:20 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:14:20 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:20 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.530s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-24630181-084a-4970-b665-dc4cf4362159 tempest-GroupSnapshotsV319Test-191098172 None] Delete group completed successfully. Sep 28 17:14:20 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-98dd5ce1-14ad-4d99-ac68-5273fff29623" returned: 0 in 0.631s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-quobyte-98dd5ce1-14ad-4d99-ac68-5273fff29623" released by "delete_volume" :: held 1.372s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Created reservations ['fb427ab9-0ba8-4d80-b887-9cba90309622', '2db6ccbe-a3b7-4708-9a9a-e03b41d8d9a2', '5c6443bc-0b00-4815-af25-20c309338acb', 'ab2dfb62-c785-411a-8db8-beefa9c93055'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:14:21 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.377s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Deleted volume successfully. Sep 28 17:14:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f431ea37-b40f-46a9-9064-cc9ee8e0b9db tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-98dd5ce1-14ad-4d99-ac68-5273fff29623-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Flow 'volume_create_manager' (c3e8cfe6-74c2-47c3-b267-f6dfa504c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f29a8cc-bc45-4362-a1bd-25eeaf3407cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f29a8cc-bc45-4362-a1bd-25eeaf3407cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1283950977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509013d3-4138-49a8-a96c-f395738e9bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e481a5ddc74e8da338a64a3e63d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:23Z,use_quota=True,user_id='e939019b959842daa2ca153fec0f353a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d372743-ffe2-4b55-a690-b9129cefc83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d372743-ffe2-4b55-a690-b9129cefc83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e39dc48-35e5-46e4-91e2-b2446648883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e39dc48-35e5-46e4-91e2-b2446648883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509013d3-4138-49a8-a96c-f395738e9bde', 'volume_name': 'volume-509013d3-4138-49a8-a96c-f395738e9bde', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c192a0b-a45c-4eee-aaf1-8d7e89b246c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c192a0b-a45c-4eee-aaf1-8d7e89b246c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a8590a-1afc-4172-8e6c-005c593f25ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:23 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Volume 509013d3-4138-49a8-a96c-f395738e9bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509013d3-4138-49a8-a96c-f395738e9bde', 'volume_size': 1} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1283950977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509013d3-4138-49a8-a96c-f395738e9bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90e481a5ddc74e8da338a64a3e63d38b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:23Z,use_quota=True,user_id='e939019b959842daa2ca153fec0f353a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Creating volume 509013d3-4138-49a8-a96c-f395738e9bde {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:23 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:23 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde 1073741824 Sep 28 17:14:23 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:23 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde 1073741824" returned: 0 in 0.724s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:23 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde Sep 28 17:14:23 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:24 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde" returned: 0 in 0.338s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a8590a-1afc-4172-8e6c-005c593f25ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509013d3-4138-49a8-a96c-f395738e9bde', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc36de-6bef-44a3-bd2e-40fb3ee3d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:24 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Volume volume-509013d3-4138-49a8-a96c-f395738e9bde (509013d3-4138-49a8-a96c-f395738e9bde): created successfully Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc36de-6bef-44a3-bd2e-40fb3ee3d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Flow 'volume_create_manager' (c3e8cfe6-74c2-47c3-b267-f6dfa504c996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b8806a69-166c-48a7-9ee2-3478ae2c711c tempest-VolumesTransfersTest-681853264 None] Created volume successfully. Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ffd3cc-cd3a-4a68-91b6-9aa0a7c5756f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:24 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:14:24 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:24 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.557s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583e989-bb2a-4b30-aa7d-0d9fe7f05c67]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:14:25 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.658s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.ccd09b7d-4098-4a6c-902f-340b7bc78467d6flhi35.img {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "cinder-509013d3-4138-49a8-a96c-f395738e9bde-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:25 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.ccd09b7d-4098-4a6c-902f-340b7bc78467d6flhi35.img Sep 28 17:14:25 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-509013d3-4138-49a8-a96c-f395738e9bde-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "cinder-quobyte-509013d3-4138-49a8-a96c-f395738e9bde" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-quobyte-509013d3-4138-49a8-a96c-f395738e9bde" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55190f5-0d3f-4a21-9572-ed065b8fb883]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde Sep 28 17:14:26 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde" returned: 0 in 1.170s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde Sep 28 17:14:27 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:28 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-509013d3-4138-49a8-a96c-f395738e9bde" returned: 0 in 0.980s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-quobyte-509013d3-4138-49a8-a96c-f395738e9bde" released by "delete_volume" :: held 2.302s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Created reservations ['42eafc29-5fda-4539-86c7-52d05f2a6781', '5806ff3c-d928-4f01-b39a-ea113ec8d40d', '5cb13a96-1d44-4d25-832e-c8232c38e7c0', 'ca47b699-f126-4821-b73f-eda3f9ce30b5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:14:28 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.610s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:29 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Deleted volume successfully. Sep 28 17:14:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c1fce2e6-06c6-4c9d-ad75-70d53831b9e5 tempest-VolumesTransfersTest-1229058961 None] Lock "cinder-509013d3-4138-49a8-a96c-f395738e9bde-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-57858591-d51b-4467-a976-cc5ae0fa086e req-f27da42b-e5e7-48e0-81aa-9bbe879a8cd3 tempest-AttachVolumeShelveTestJSON-690341656 None] No connector for attachment 783e8fb2-2e93-45ef-81ee-45736b9be4a9; skipping storage backend terminate_connection call. {{(pid=86929) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:14:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-57858591-d51b-4467-a976-cc5ae0fa086e req-f27da42b-e5e7-48e0-81aa-9bbe879a8cd3 tempest-AttachVolumeShelveTestJSON-690341656 None] Deleting attachment 783e8fb2-2e93-45ef-81ee-45736b9be4a9. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:14:36 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.ccd09b7d-4098-4a6c-902f-340b7bc78467d6flhi35.img" returned: 0 in 11.327s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eed8567-1c7c-4fcd-a3e9-a52e180d024b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:14:37 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9ced25ec-d565-4bee-93d7-605038facac3 tempest-GroupsV314Test-1663474850 None] Group tempest-GroupsV314Test-Group-716718110: creating Sep 28 17:14:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9ced25ec-d565-4bee-93d7-605038facac3 tempest-GroupsV314Test-1663474850 None] Group tempest-GroupsV314Test-Group-716718110: created successfully Sep 28 17:14:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9ced25ec-d565-4bee-93d7-605038facac3 tempest-GroupsV314Test-1663474850 None] Create group completed successfully. Sep 28 17:14:37 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.897s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668, size 1024.00 MB, duration 11.33 sec, destination /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.ccd09b7d-4098-4a6c-902f-340b7bc78467d6flhi35.img {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:14:37 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Converted 1024.00 MB image at 90.38 MB/s Sep 28 17:14:37 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] ccd09b7d-4098-4a6c-902f-340b7bc78467 was raw, no need to convert to raw {{(pid=86929) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=92,cinder:UPDATE=96,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=93,cinder:UPDATE=91,cinder:INSERT=27,cinder:DELETE=4 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Flow 'volume_create_manager' (9fa0b67b-b62f-479d-b4d9-ab18be658e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc813e1-fe03-498a-bf43-c80bc4852947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbc813e1-fe03-498a-bf43-c80bc4852947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794027292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff1bc04b-c36d-4110-82fc-89e54c41b438,host='devstack@QuobyteHD#QuobyteHD',id=665bc047-7ef9-4569-9c6e-bbdc943237aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed99dcf2a5ca468e95a59927b99e29dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:39Z,use_quota=True,user_id='81f8fc814dbb471e95c41a1f01763115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fea7ab45-7f5a-4d98-b6e4-202cc85e9f5d),volume_type_id=fea7ab45-7f5a-4d98-b6e4-202cc85e9f5d)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a553c57-c7d0-429b-a983-09a0ee3aa93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a553c57-c7d0-429b-a983-09a0ee3aa93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a606d9-b513-4938-b56b-14b5c2fc42f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a606d9-b513-4938-b56b-14b5c2fc42f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665bc047-7ef9-4569-9c6e-bbdc943237aa', 'volume_name': 'volume-665bc047-7ef9-4569-9c6e-bbdc943237aa', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a80a81d-7fdb-42e3-a2e2-c4ddae18b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a80a81d-7fdb-42e3-a2e2-c4ddae18b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92058331-9f48-4893-bd2d-8d7abb71349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:39 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Volume 665bc047-7ef9-4569-9c6e-bbdc943237aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665bc047-7ef9-4569-9c6e-bbdc943237aa', 'volume_size': 1} Sep 28 17:14:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Flow 'volume_create_manager' (df2e3e54-b27b-46b3-9c9e-abebe2f0f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e89ae5a-01a8-4e1a-88fd-0c4a713281bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e89ae5a-01a8-4e1a-88fd-0c4a713281bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1073542121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82629b9e-7aaf-4846-8710-b5f8cfcb6d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c193dd75e649ea92fb862a541f9f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:47Z,use_quota=True,user_id='618819c490024032afc13aae602cd442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05810d43-da82-4064-b4d1-f845fa53583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05810d43-da82-4064-b4d1-f845fa53583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895cccf-62b4-438a-bf20-3ecdad81dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a895cccf-62b4-438a-bf20-3ecdad81dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82629b9e-7aaf-4846-8710-b5f8cfcb6d81', 'volume_name': 'volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81', 'volume_size': 2}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87412616-a99a-4959-9daa-d186a769ce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87412616-a99a-4959-9daa-d186a769ce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa35dd7-5058-4cc9-aa4f-57eebf09557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Volume 82629b9e-7aaf-4846-8710-b5f8cfcb6d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81', 'volume_size': 2} Sep 28 17:14:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:56 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:56 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.413s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Uploaded volume to glance image-id: ccd09b7d-4098-4a6c-902f-340b7bc78467. {{(pid=86929) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.048s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff1bc04b-c36d-4110-82fc-89e54c41b438,created_at=2026-09-28T15:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1794027292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff1bc04b-c36d-4110-82fc-89e54c41b438,host='devstack@QuobyteHD#QuobyteHD',id=665bc047-7ef9-4569-9c6e-bbdc943237aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed99dcf2a5ca468e95a59927b99e29dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:39Z,use_quota=True,user_id='81f8fc814dbb471e95c41a1f01763115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fea7ab45-7f5a-4d98-b6e4-202cc85e9f5d),volume_type_id=fea7ab45-7f5a-4d98-b6e4-202cc85e9f5d)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Creating volume 665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:06 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa 1073741824 Sep 28 17:15:06 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7c2d1182-f925-45c7-aa82-6f62a39bf4c7 tempest-VolumesActionsTest-1484647135 None] Copy volume to image completed successfully. Sep 28 17:15:07 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa 1073741824" returned: 0 in 0.547s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:07 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:07 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.282s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.791s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1073542121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82629b9e-7aaf-4846-8710-b5f8cfcb6d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c193dd75e649ea92fb862a541f9f33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:47Z,use_quota=True,user_id='618819c490024032afc13aae602cd442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Creating volume 82629b9e-7aaf-4846-8710-b5f8cfcb6d81 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:07 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 2147483648 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92058331-9f48-4893-bd2d-8d7abb71349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665bc047-7ef9-4569-9c6e-bbdc943237aa', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:07 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 2147483648 Sep 28 17:15:07 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9e66de-abfe-4ef1-adea-4d4de66fd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:07 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Volume volume-665bc047-7ef9-4569-9c6e-bbdc943237aa (665bc047-7ef9-4569-9c6e-bbdc943237aa): created successfully Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9e66de-abfe-4ef1-adea-4d4de66fd262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Flow 'volume_create_manager' (9fa0b67b-b62f-479d-b4d9-ab18be658e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b6713ecd-c7e9-4412-b5ae-2838d31aad45 tempest-GroupsV314Test-1663474850 None] Created volume successfully. Sep 28 17:15:07 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.367s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:08 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 2147483648" returned: 0 in 0.612s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 Sep 28 17:15:08 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" returned: 0 in 0.301s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.245s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa35dd7-5058-4cc9-aa4f-57eebf09557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81', 'volume_size': 2}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58523cf1-eba1-46e4-8ada-17525b10df03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda08d64-ed1c-4720-af54-9d42c2b731be]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Volume volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 (82629b9e-7aaf-4846-8710-b5f8cfcb6d81): created successfully Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58523cf1-eba1-46e4-8ada-17525b10df03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Flow 'volume_create_manager' (df2e3e54-b27b-46b3-9c9e-abebe2f0f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-77909c0b-f39c-406b-b933-18d25e0a70ac tempest-VolumesCloneNegativeTest-32586998 None] Created volume successfully. Sep 28 17:15:08 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:15:08 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.481s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b390a43-5173-42c7-b19f-55c213b627ca]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Acquiring lock "cinder-82629b9e-7aaf-4846-8710-b5f8cfcb6d81-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "cinder-82629b9e-7aaf-4846-8710-b5f8cfcb6d81-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Acquiring lock "cinder-quobyte-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "cinder-quobyte-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:09 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:15:09 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfbf0a-4f8d-459f-ba41-4c97a62a9eb3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 Sep 28 17:15:09 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:09 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.520s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img Sep 28 17:15:09 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81 Sep 28 17:15:09 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" returned: 0 in 0.314s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "cinder-quobyte-82629b9e-7aaf-4846-8710-b5f8cfcb6d81" released by "delete_volume" :: held 0.850s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Created reservations ['bdfb8a78-0282-4b6b-be3a-17861000548e', 'e160a475-bb27-486a-8b97-2341bc198fc0', '07f9905a-6461-41fc-a248-dc4c1e35b8dd', 'c3c8b690-bf50-474f-9b4a-24d8a6638958'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:10 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.565s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Deleted volume successfully. Sep 28 17:15:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c174c7c3-4964-40b5-acae-93a062e49525 tempest-VolumesCloneNegativeTest-32586998 None] Lock "cinder-82629b9e-7aaf-4846-8710-b5f8cfcb6d81-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:20 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img" returned: 0 in 10.330s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9741a1-002c-4ce1-b717-fcc561136097]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:15:20 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=12,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:20 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.638s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668, size 1024.00 MB, duration 10.33 sec, destination /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:20 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Converted 1024.00 MB image at 99.09 MB/s Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] 19c23e9b-0b28-4f21-8f35-c82f2e1ff68c was raw, converting to qcow2 {{(pid=86929) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f145a6-91de-4f2d-9612-4cd3b4d92e04]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img Sep 28 17:15:20 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img" returned: 0 in 0.476s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img Sep 28 17:15:21 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img" returned: 1 in 0.575s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0 Sep 28 17:15:21 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:22 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0" returned: 0 in 0.448s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:22 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Image conversion details: src /opt/stack/data/cinder/conversion/bd47c525-ed31-4ed3-b9c7-7255a8d90668.temp_image.19c23e9b-0b28-4f21-8f35-c82f2e1ff68c1ly013d2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:22 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:15:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1232f620-eb27-4d08-9614-90e9a9f12bf9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:22 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0 Sep 28 17:15:22 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:22 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gxt8n0a0" returned: 0 in 0.514s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Acquiring lock "cinder-be7b8877-9063-4002-a2ab-b807ef376b93-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "cinder-be7b8877-9063-4002-a2ab-b807ef376b93-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Acquiring lock "cinder-quobyte-be7b8877-9063-4002-a2ab-b807ef376b93" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "cinder-quobyte-be7b8877-9063-4002-a2ab-b807ef376b93" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd54082-c042-41f1-90bb-00b73d0e298f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 Sep 28 17:15:24 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93" returned: 0 in 0.588s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93 Sep 28 17:15:24 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-be7b8877-9063-4002-a2ab-b807ef376b93" returned: 0 in 0.344s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "cinder-quobyte-be7b8877-9063-4002-a2ab-b807ef376b93" released by "delete_volume" :: held 1.018s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Created reservations ['235ec997-aa40-47d9-99a0-82c69ffa8384', '462a1da5-e033-40cd-bfba-4a12376e1077', '5115fd7b-4c2f-4a22-b031-7aff92be6bb1', 'c9144451-5ecf-4232-be0d-85b801cc3403'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.422s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Uploaded volume to glance image-id: 19c23e9b-0b28-4f21-8f35-c82f2e1ff68c. {{(pid=86929) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.417s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:25 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Cloning volume 665bc047-7ef9-4569-9c6e-bbdc943237aa to volume 541a6fa5-c4a9-412a-b919-ad6e92ba134f Sep 28 17:15:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e0f044a3-fb97-43b0-ae2d-448e0832838f tempest-VolumesActionsTest-1484647135 None] Copy volume to image completed successfully. Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Creating offline snapshot 9c9fccb3-d531-4a63-9e91-16cc00979f77 of volume 665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:25 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:25 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[25870c00-45de-476f-8e80-dbc1698d6120]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:25 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.335s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Deleted volume successfully. Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4135e8fa-05b0-42c0-8ec1-d4cf41f9b551 tempest-AttachVolumeShelveTestJSON-690341656 None] Lock "cinder-be7b8877-9063-4002-a2ab-b807ef376b93-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:25 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Flow 'volume_create_manager' (545288c0-97a8-41be-83b3-1ea64fe69a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696b149d-8f0d-45d6-bee4-eaa188e19da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.509s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696b149d-8f0d-45d6-bee4-eaa188e19da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1601189397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81229894-891d-424c-9d79-cc01cc7c7290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21ce1de8edf454598aa05957ae38ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:26Z,use_quota=True,user_id='1a9f1724fa11400487aed8698373c2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:25 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 1G Sep 28 17:15:25 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f952e4-2433-4744-844b-9ccd8b72032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f952e4-2433-4744-844b-9ccd8b72032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb152593-3ef0-4d22-a10f-dda301d7c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb152593-3ef0-4d22-a10f-dda301d7c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81229894-891d-424c-9d79-cc01cc7c7290', 'volume_name': 'volume-81229894-891d-424c-9d79-cc01cc7c7290', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebca33d-a0a3-48a5-8f12-089b2e113924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebca33d-a0a3-48a5-8f12-089b2e113924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd7ed5f-65f3-4659-8232-7a005b705fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:25 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Volume 81229894-891d-424c-9d79-cc01cc7c7290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81229894-891d-424c-9d79-cc01cc7c7290', 'volume_size': 1} Sep 28 17:15:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:26 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 1G" returned: 0 in 0.592s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665bc047-7ef9-4569-9c6e-bbdc943237aa -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665bc047-7ef9-4569-9c6e-bbdc943237aa -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:26 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Acquiring lock "cinder-quobyte-bd47c525-ed31-4ed3-b9c7-7255a8d90668" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-quobyte-bd47c525-ed31-4ed3-b9c7-7255a8d90668" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdcf769-f400-47eb-a5b7-3200a20ca57a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665bc047-7ef9-4569-9c6e-bbdc943237aa -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:15:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:26 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:15:26 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.326s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.450s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668 Sep 28 17:15:27 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info Sep 28 17:15:27 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd47c525-ed31-4ed3-b9c7-7255a8d90668" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-quobyte-bd47c525-ed31-4ed3-b9c7-7255a8d90668" released by "delete_volume" :: held 0.884s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:27 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info" returned: 0 in 0.378s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info Sep 28 17:15:27 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Created reservations ['32813c0f-9f9c-46f9-9fa2-7623b20cfe35', '7690f635-7055-4348-86a9-fb3ec708df58', 'b6fe3950-07fa-4f47-ad9f-e971b6c80dc9', 'c96306ea-edaa-4878-a2f6-0a001e6962b1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:27 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.info" returned: 0 in 0.403s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Acquiring lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] snapshot: 9c9fccb3-d531-4a63-9e91-16cc00979f77, volume: 541a6fa5-c4a9-412a-b919-ad6e92ba134f, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:15:28 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.319s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Deleted volume successfully. Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b0c5bf-9259-4f87-b8fa-0d0541f559e2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08a2886e-e5ce-45a3-bf87-1e37f4db34a8 tempest-VolumesActionsTest-1484647135 None] Lock "cinder-bd47c525-ed31-4ed3-b9c7-7255a8d90668-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:28 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:28 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.516s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665bc047-7ef9-4569-9c6e-bbdc943237aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9118a7ee-b022-42ca-bbc0-894986f40c73]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:28 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.510s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:15:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:15:29 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:15:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f Sep 28 17:15:29 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:37 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=20,cinder:UPDATE=36,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:38 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f" returned: 0 in 9.158s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa, size 1024.00 MB, duration 9.16 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:38 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Converted 1024.00 MB image at 111.78 MB/s Sep 28 17:15:38 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f Sep 28 17:15:38 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:38 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f" returned: 0 in 0.333s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" released by "_copy_volume_from_snapshot" :: held 10.647s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Acquiring lock "cinder-quobyte-9c9fccb3-d531-4a63-9e91-16cc00979f77" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-9c9fccb3-d531-4a63-9e91-16cc00979f77" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Deleting offline snapshot 9c9fccb3-d531-4a63-9e91-16cc00979f77 of volume 665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] snapshot_file for this snap is: volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de657e5-e72d-4df4-8789-1b54faf47184]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:38 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:38 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:39 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.514s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665bc047-7ef9-4569-9c6e-bbdc943237aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cd8a12-84f9-46eb-a2a8-b37528c82345]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:39 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:39 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:40 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.813s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:40 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:40 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.548s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:40 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77 Sep 28 17:15:40 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:41 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa.9c9fccb3-d531-4a63-9e91-16cc00979f77" returned: 0 in 0.377s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-9c9fccb3-d531-4a63-9e91-16cc00979f77" released by "_delete_snapshot" :: held 2.436s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.114s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.338s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1601189397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81229894-891d-424c-9d79-cc01cc7c7290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21ce1de8edf454598aa05957ae38ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:26Z,use_quota=True,user_id='1a9f1724fa11400487aed8698373c2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Creating volume 81229894-891d-424c-9d79-cc01cc7c7290 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:41 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 1073741824 Sep 28 17:15:41 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f27bf8cb-56eb-4705-969e-1aa7d2c74bec tempest-GroupsV314Test-1663474850 None] Create group from source-group-ff1bc04b-c36d-4110-82fc-89e54c41b438 completed successfully. Sep 28 17:15:41 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 1073741824" returned: 0 in 0.725s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:42 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 Sep 28 17:15:42 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:42 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290" returned: 0 in 0.496s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd7ed5f-65f3-4659-8232-7a005b705fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81229894-891d-424c-9d79-cc01cc7c7290', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf1fc3-7a81-4331-80e2-0ab94a74cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Volume volume-81229894-891d-424c-9d79-cc01cc7c7290 (81229894-891d-424c-9d79-cc01cc7c7290): created successfully Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2edf1fc3-7a81-4331-80e2-0ab94a74cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Flow 'volume_create_manager' (545288c0-97a8-41be-83b3-1ea64fe69a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-165e6d65-9717-4279-872d-c9e1487ae157 tempest-VolumesNegativeTest-1250162478 None] Created volume successfully. Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Acquiring lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6da80c7-e10a-4fd9-8b60-5f44959a56d6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:43 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f Sep 28 17:15:43 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (3c2885ea-3481-451d-b380-cbb507f3a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95715c7-ce80-4920-8643-cc051e5fbf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95715c7-ce80-4920-8643-cc051e5fbf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097083538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aea2df6-faa4-444a-a973-9270a5750c77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:43Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57434093-b87d-4f6f-bca0-2bc80417c4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57434093-b87d-4f6f-bca0-2bc80417c4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe446b23-188b-4ceb-a14f-8a1fe0834ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe446b23-188b-4ceb-a14f-8a1fe0834ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aea2df6-faa4-444a-a973-9270a5750c77', 'volume_name': 'volume-1aea2df6-faa4-444a-a973-9270a5750c77', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb31786-cbf3-4289-b272-1ffc7c874df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb31786-cbf3-4289-b272-1ffc7c874df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960f10ed-6731-40df-83d2-964fc620ef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Volume 1aea2df6-faa4-444a-a973-9270a5750c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aea2df6-faa4-444a-a973-9270a5750c77', 'volume_size': 1} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097083538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aea2df6-faa4-444a-a973-9270a5750c77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:43Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Creating volume 1aea2df6-faa4-444a-a973-9270a5750c77 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:43 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:43 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 1073741824 Sep 28 17:15:43 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:43 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f" returned: 0 in 0.600s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:43 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f Sep 28 17:15:43 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-541a6fa5-c4a9-412a-b919-ad6e92ba134f" returned: 0 in 0.441s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-541a6fa5-c4a9-412a-b919-ad6e92ba134f" released by "delete_volume" :: held 1.157s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Created reservations ['942d1ec3-46e2-49da-a313-0118890f60d3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:44 devstack cinder-volume[86929]: WARNING cinder.quota [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-538602094 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-538602094, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:15:44 devstack cinder-volume[86929]: WARNING cinder.quota [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-538602094 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-538602094, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Created reservations ['68fd3458-ff54-441e-8d4a-2f0846f47859', '2503b649-5283-4038-b194-e80c715e8960', '984b475d-b302-4ec8-98f8-cd593b12efe8', '9c57d2d8-16cc-4693-ac77-04b7cf912ee8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:44 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 1073741824" returned: 0 in 0.870s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 Sep 28 17:15:44 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:44 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:45 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77" returned: 0 in 0.483s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960f10ed-6731-40df-83d2-964fc620ef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aea2df6-faa4-444a-a973-9270a5750c77', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308e9fc9-d128-4564-8871-1bbcb74d313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Volume volume-1aea2df6-faa4-444a-a973-9270a5750c77 (1aea2df6-faa4-444a-a973-9270a5750c77): created successfully Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308e9fc9-d128-4564-8871-1bbcb74d313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (3c2885ea-3481-451d-b380-cbb507f3a02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8ecd30af-862e-4fbc-8979-499a95aa5ea4 tempest-VolumesListTestJSON-898093938 None] Created volume successfully. Sep 28 17:15:45 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ab0b0ff8-3436-443a-9e52-edc2f9b212d6 tempest-GroupsV314Test-1663474850 None] Delete group completed successfully. Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Acquiring lock "cinder-quobyte-665bc047-7ef9-4569-9c6e-bbdc943237aa" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-665bc047-7ef9-4569-9c6e-bbdc943237aa" acquired by "delete_volume" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee00f62b-ff05-4cb9-b874-32601602f6ce]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (b1a506ec-3482-4527-9298-19a44e1e50a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93e929-4070-4f0c-993a-2bfddcd144ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:46 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93e929-4070-4f0c-993a-2bfddcd144ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1864695327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1129881c-f5e8-4c01-9de7-59bfa6579f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad36b90-dcda-4a88-9e08-31eeedc81a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad36b90-dcda-4a88-9e08-31eeedc81a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080a53e8-497b-47f2-9863-52f4a0dea798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080a53e8-497b-47f2-9863-52f4a0dea798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1129881c-f5e8-4c01-9de7-59bfa6579f4f', 'volume_name': 'volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d648c312-c964-4a25-b597-f4ba0eca01ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d648c312-c964-4a25-b597-f4ba0eca01ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9bf0c-cabb-45bc-878c-ac549e94098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Volume 1129881c-f5e8-4c01-9de7-59bfa6579f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f', 'volume_size': 1} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1864695327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1129881c-f5e8-4c01-9de7-59bfa6579f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Creating volume 1129881c-f5e8-4c01-9de7-59bfa6579f4f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:46 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:46 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f 1073741824 Sep 28 17:15:46 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:47 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.980s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:47 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa Sep 28 17:15:47 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:47 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f 1073741824" returned: 0 in 0.818s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:47 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f Sep 28 17:15:47 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:48 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-665bc047-7ef9-4569-9c6e-bbdc943237aa" returned: 0 in 0.570s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Lock "cinder-quobyte-665bc047-7ef9-4569-9c6e-bbdc943237aa" released by "delete_volume" :: held 1.743s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Created reservations ['0046075d-9fa5-44b4-ab9b-b23ada5d80e0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Created reservations ['d8d68d4d-5859-4986-b52f-54f7adc8f6e9', '6065ec7b-c803-45b3-9f46-e476efb2c53d', '087cf84a-08f3-45a2-ba86-5084de9d3b09', '50b480bb-2db1-4e27-90d6-321c28ace36d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:48 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f" returned: 0 in 0.618s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf9bf0c-cabb-45bc-878c-ac549e94098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c1cbf-d19a-424c-98f2-e5ea4a355afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Volume volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f (1129881c-f5e8-4c01-9de7-59bfa6579f4f): created successfully Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c1cbf-d19a-424c-98f2-e5ea4a355afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (b1a506ec-3482-4527-9298-19a44e1e50a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6f7f3cb2-cd06-4973-9715-4e132f9b5a28 tempest-VolumesListTestJSON-898093938 None] Created volume successfully. Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:48 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:48 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:49 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.377s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2c06b3b9-05c6-4450-8b44-d71ba4724a25 tempest-GroupsV314Test-1663474850 None] Delete group completed successfully. Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (87590b5d-063e-41ab-b0d6-b9148dd6efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644c4a77-1300-4f81-9db1-0f2efcfd7c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644c4a77-1300-4f81-9db1-0f2efcfd7c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-509066804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9a4f7a-c8c8-482c-8363-1f10ce42d457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40785fc4-3a42-454d-8e5f-a4ca439cc48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40785fc4-3a42-454d-8e5f-a4ca439cc48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1074a8eb-1d97-4520-93ce-66828bee214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1074a8eb-1d97-4520-93ce-66828bee214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9a4f7a-c8c8-482c-8363-1f10ce42d457', 'volume_name': 'volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8ffb9c-9c95-4e62-b9cd-b95d23cbc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8ffb9c-9c95-4e62-b9cd-b95d23cbc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d673ef2-580b-48f2-83a3-9e0941ad5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Volume 2a9a4f7a-c8c8-482c-8363-1f10ce42d457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457', 'volume_size': 1} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-509066804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9a4f7a-c8c8-482c-8363-1f10ce42d457,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c266e083d71d458f84823bbf8f7c772f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='c2381f25378d4c3cbd6cfa19d8de8d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Creating volume 2a9a4f7a-c8c8-482c-8363-1f10ce42d457 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:49 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:15:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:49 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 1073741824 Sep 28 17:15:49 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 1073741824" returned: 0 in 0.872s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 Sep 28 17:15:50 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" returned: 0 in 0.498s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d673ef2-580b-48f2-83a3-9e0941ad5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc0ded7-2384-451b-8063-24a5b5711495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Volume volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 (2a9a4f7a-c8c8-482c-8363-1f10ce42d457): created successfully Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc0ded7-2384-451b-8063-24a5b5711495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Flow 'volume_create_manager' (87590b5d-063e-41ab-b0d6-b9148dd6efd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-348174bb-a903-4625-bd06-fc1b67efbfff tempest-VolumesListTestJSON-898093938 None] Created volume successfully. Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-2a9a4f7a-c8c8-482c-8363-1f10ce42d457-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-2a9a4f7a-c8c8-482c-8363-1f10ce42d457-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-quobyte-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44e9f9-973f-4873-a6cc-6a381beed5be]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:55 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 Sep 28 17:15:55 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" returned: 0 in 0.682s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457 Sep 28 17:15:56 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" returned: 0 in 0.733s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-2a9a4f7a-c8c8-482c-8363-1f10ce42d457" released by "delete_volume" :: held 1.515s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Created reservations ['e2536755-930d-4d17-9a48-6fe56a51aabc', '4e08da11-295a-47ce-9f0a-f8a59536030b', '9fd9c676-6ff1-4017-a2ae-e84b25527752', 'b3e9933f-6ce6-48dd-bb31-b272363bc3bd'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:57 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:15:57 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.511s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Deleted volume successfully. Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-08e74fad-693c-4ee8-8298-bff1d3d71964 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-2a9a4f7a-c8c8-482c-8363-1f10ce42d457-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-1129881c-f5e8-4c01-9de7-59bfa6579f4f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-1129881c-f5e8-4c01-9de7-59bfa6579f4f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-quobyte-1129881c-f5e8-4c01-9de7-59bfa6579f4f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-1129881c-f5e8-4c01-9de7-59bfa6579f4f" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0082822-ee5a-4cc2-b856-5023573290bd]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f Sep 28 17:15:58 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f" returned: 0 in 0.868s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f Sep 28 17:15:59 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1129881c-f5e8-4c01-9de7-59bfa6579f4f" returned: 0 in 0.583s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-1129881c-f5e8-4c01-9de7-59bfa6579f4f" released by "delete_volume" :: held 1.571s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Created reservations ['148263e9-5a69-4d54-88d9-081785b9d845', 'c2977a63-2b50-40db-8bf5-ae3a80d4352f', 'eecd3c7a-283d-448e-bfde-9ae584ad300d', 'fac5a9d8-629f-470c-8cda-39aea6f43217'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:16:00 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-1aea2df6-faa4-444a-a973-9270a5750c77-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-1aea2df6-faa4-444a-a973-9270a5750c77-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "cinder-quobyte-1aea2df6-faa4-444a-a973-9270a5750c77" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-1aea2df6-faa4-444a-a973-9270a5750c77" acquired by "delete_volume" :: waited 0.063s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa9840a-5614-463d-bbba-8e8efd51687e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.922s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Deleted volume successfully. Sep 28 17:16:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ffc311f2-3ce1-4afd-836b-9916df987ff4 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-1129881c-f5e8-4c01-9de7-59bfa6579f4f-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:01 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 Sep 28 17:16:01 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77" returned: 0 in 0.943s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77 Sep 28 17:16:02 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1aea2df6-faa4-444a-a973-9270a5750c77" returned: 0 in 0.731s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-quobyte-1aea2df6-faa4-444a-a973-9270a5750c77" released by "delete_volume" :: held 1.821s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Created reservations ['e1d94cdc-165f-4bba-bf0b-0245587dd6b6', '4d0101ae-a5a6-41b0-8d15-3c66ef44b484', 'a4b90a06-54d8-4a02-9267-5fd5583f5f2d', 'f3046026-4274-4a1f-ab3a-b7c8c72f56a1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:03 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:16:03 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:03 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.552s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Deleted volume successfully. Sep 28 17:16:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-87d04aac-f69b-4ced-9e1c-21f72c42d952 tempest-VolumesListTestJSON-898093938 None] Lock "cinder-1aea2df6-faa4-444a-a973-9270a5750c77-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Flow 'volume_create_manager' (dc5c0a22-4ff1-4f5d-bf50-d5f090c3db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219eeaac-90c9-4b8d-8359-67dfd2433b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219eeaac-90c9-4b8d-8359-67dfd2433b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-92935018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92262fb6-c21a-42eb-a312-4e2a607e4113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3999b2d91f460d9c26d6b7af4989e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:09Z,use_quota=True,user_id='d538f3f9877245b88ad21ba7c7737b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54127fe5-e791-40b1-a7c7-004966bccb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54127fe5-e791-40b1-a7c7-004966bccb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd6e276-27b2-48dc-8233-10cc59a05f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd6e276-27b2-48dc-8233-10cc59a05f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92262fb6-c21a-42eb-a312-4e2a607e4113', 'volume_name': 'volume-92262fb6-c21a-42eb-a312-4e2a607e4113', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f77c6-31f5-4545-997d-9b111aa635ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f77c6-31f5-4545-997d-9b111aa635ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e313142-2228-4554-99ae-accd365218da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Volume 92262fb6-c21a-42eb-a312-4e2a607e4113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92262fb6-c21a-42eb-a312-4e2a607e4113', 'volume_size': 1} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-92935018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92262fb6-c21a-42eb-a312-4e2a607e4113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f3999b2d91f460d9c26d6b7af4989e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:09Z,use_quota=True,user_id='d538f3f9877245b88ad21ba7c7737b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Creating volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:09 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:16:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 1073741824 Sep 28 17:16:09 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 1073741824" returned: 0 in 0.907s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 Sep 28 17:16:10 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113" returned: 0 in 0.501s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e313142-2228-4554-99ae-accd365218da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92262fb6-c21a-42eb-a312-4e2a607e4113', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd2b96-c3bd-4046-af47-4c3bfccf2c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Volume volume-92262fb6-c21a-42eb-a312-4e2a607e4113 (92262fb6-c21a-42eb-a312-4e2a607e4113): created successfully Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd2b96-c3bd-4046-af47-4c3bfccf2c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Flow 'volume_create_manager' (dc5c0a22-4ff1-4f5d-bf50-d5f090c3db6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b7bcbd2b-8c64-4379-88b3-4b9c373c6742 tempest-SnapshotsActionsTest-621291495 None] Created volume successfully. Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Creating offline snapshot c74e92f7-535c-42a4-967f-b628160f9d19 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Flow 'volume_create_manager' (4ad9cd25-6f52-48b1-b593-233c7fc7d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3524f-913c-4e8f-beb6-213348ce26f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[05243641-1d0c-4e5a-a1a4-c646e3d2e732]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd3524f-913c-4e8f-beb6-213348ce26f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1431717436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66eff4d-6e79-4694-a85d-6f93305ba89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc12645e8634452b39d2b4d64ee531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:12Z,use_quota=True,user_id='54f37d73da14481f9f5e04d4ae64c5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f05fee0-30cb-48aa-b46e-43e3107c8328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f05fee0-30cb-48aa-b46e-43e3107c8328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a8167f-da6a-4930-81d2-221b7522fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a8167f-da6a-4930-81d2-221b7522fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66eff4d-6e79-4694-a85d-6f93305ba89b', 'volume_name': 'volume-c66eff4d-6e79-4694-a85d-6f93305ba89b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4aa1c4-f188-4119-ad62-74e65c8408da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4aa1c4-f188-4119-ad62-74e65c8408da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbc3616-e1af-4084-a98d-477704343f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:12 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Volume c66eff4d-6e79-4694-a85d-6f93305ba89b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66eff4d-6e79-4694-a85d-6f93305ba89b', 'volume_size': 1} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:12 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 Sep 28 17:16:12 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:12 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113" returned: 0 in 0.481s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:12 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 1G Sep 28 17:16:12 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:13 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 1G" returned: 0 in 0.666s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:13 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:13 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:13 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.463s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:13 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 is being set with open permissions: ugo+rw Sep 28 17:16:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:13 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:13 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info Sep 28 17:16:14 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info" returned: 0 in 0.633s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info is being set with open permissions: ugo+rw Sep 28 17:16:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info Sep 28 17:16:14 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:15 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.info" returned: 0 in 0.524s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.355s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.153s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1431717436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66eff4d-6e79-4694-a85d-6f93305ba89b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc12645e8634452b39d2b4d64ee531c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:12Z,use_quota=True,user_id='54f37d73da14481f9f5e04d4ae64c5d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Creating volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:15 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:16:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:15 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b 1073741824 Sep 28 17:16:15 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:15 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8272ecfb-1c26-4a4b-a4e7-676068002cea tempest-SnapshotsActionsTest-621291495 None] Create snapshot completed successfully Sep 28 17:16:16 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b 1073741824" returned: 0 in 1.056s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:16 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b Sep 28 17:16:16 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:17 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b" returned: 0 in 0.466s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbc3616-e1af-4084-a98d-477704343f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66eff4d-6e79-4694-a85d-6f93305ba89b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069a9aaf-61a2-41b9-88f9-0d0f7a769e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Volume volume-c66eff4d-6e79-4694-a85d-6f93305ba89b (c66eff4d-6e79-4694-a85d-6f93305ba89b): created successfully Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069a9aaf-61a2-41b9-88f9-0d0f7a769e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Flow 'volume_create_manager' (4ad9cd25-6f52-48b1-b593-233c7fc7d932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-22ff5c3f-b205-4452-8570-b20cc8bb1b81 tempest-VolumesSnapshotListTestJSON-1429509923 None] Created volume successfully. Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Creating offline snapshot dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bcbb83-d0a0-4bab-87f4-6e0189f2ad12]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:17 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:17 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:18 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.813s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:18 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 1G Sep 28 17:16:18 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 1G" returned: 0 in 0.897s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 Sep 28 17:16:19 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:20 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" returned: 0 in 0.646s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 is being set with open permissions: ugo+rw Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:20 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 Sep 28 17:16:20 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:20 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" returned: 0 in 0.552s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.577s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Creating offline snapshot a307f3d0-a085-4edd-816b-9d575e301c85 of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cd7b683d-dd4a-4c73-84dd-ba03a3059f0c tempest-SnapshotsActionsTest-621291495 None] Create snapshot completed successfully Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[351f877d-3a39-4735-8ea5-1fa75bb80114]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:20 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b Sep 28 17:16:20 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:21 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b" returned: 0 in 0.719s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:21 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 1G Sep 28 17:16:21 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Acquiring lock "cinder-81229894-891d-424c-9d79-cc01cc7c7290-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "cinder-81229894-891d-424c-9d79-cc01cc7c7290-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Acquiring lock "cinder-quobyte-81229894-891d-424c-9d79-cc01cc7c7290" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "cinder-quobyte-81229894-891d-424c-9d79-cc01cc7c7290" acquired by "delete_volume" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbae62d-db30-4ed9-9dfe-ec9c232632d9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Deleting offline snapshot dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] snapshot_file for this snap is: volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f4a045-afe4-43b0-89b8-3579e41c85e4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 Sep 28 17:16:22 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:22 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 Sep 28 17:16:22 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:22 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 1G" returned: 0 in 1.172s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:22 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:22 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290" returned: 0 in 0.836s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290 Sep 28 17:16:23 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" returned: 0 in 0.795s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c911a86-ce2b-47d5-b9b3-48a6e832c1bd]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:23 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.674s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 is being set with open permissions: ugo+rw Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:23 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:23 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:23 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-81229894-891d-424c-9d79-cc01cc7c7290" returned: 0 in 0.651s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "cinder-quobyte-81229894-891d-424c-9d79-cc01cc7c7290" released by "delete_volume" :: held 1.609s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.418s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:23 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Created reservations ['83178792-4dcb-4abf-b167-89756db2fdc6', '60ddc7da-de1a-46a3-b58d-292ff97242f8', '6191793a-066a-4e46-bbb7-e1f0910bb456', '98440d64-4691-40c7-86ff-16754a970428'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:23 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info Sep 28 17:16:23 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.827s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:24 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 Sep 28 17:16:24 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info" returned: 0 in 0.626s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info is being set with open permissions: ugo+rw Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info Sep 28 17:16:24 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.717s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Deleted volume successfully. Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-532dbbfd-ac6b-4cf1-8be9-a42a6f27f339 tempest-VolumesNegativeTest-1250162478 None] Lock "cinder-81229894-891d-424c-9d79-cc01cc7c7290-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:24 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.info" returned: 0 in 0.491s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9a06d3d1-4b27-4981-a10a-ca4e1b976e43 tempest-VolumesSnapshotListTestJSON-1429509923 None] Create snapshot completed successfully Sep 28 17:16:25 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" returned: 0 in 1.044s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2 Sep 28 17:16:25 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:25 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" returned: 0 in 0.544s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2" released by "_delete_snapshot" :: held 3.424s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_snapshot" :: held 3.471s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Created reservations ['5a3def3d-d19d-4999-b63b-0190e82ca291', 'd7d9f44e-0645-4edd-8f15-d7cd46b71567', '363314da-fdcd-495c-84cd-20906d570e69', '50b652bb-2bc1-41b6-879f-138de0a7c172'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Creating offline snapshot 5d756cdd-4a75-4f12-bd94-b5ea329041d8 of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbd5d4a-e99e-46e6-88ce-a5afa2b8e3ed]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Delete snapshot completed successfully. Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d46baa5-7866-42fd-958b-e0dc532ad36e tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-dbd1ccb8-ed98-4e01-9df1-61a3b93ed9e2-delete_snapshot" released by "delete_snapshot" :: held 3.885s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:26 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:26 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:26 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:26 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 1G Sep 28 17:16:26 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:27 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 1G" returned: 0 in 0.952s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:27 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:27 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:27 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 is being set with open permissions: ugo+rw Sep 28 17:16:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:27 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:27 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:28 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.398s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.880s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Creating offline snapshot 095caec7-9605-4313-9325-ff85583e3e97 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ef1b42f9-c3c3-4e01-92dd-dcd933077f98 tempest-VolumesSnapshotListTestJSON-1429509923 None] Create snapshot completed successfully Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0485562b-ab2b-4658-a738-42f3a2d13ed5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:28 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:28 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:29 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.635s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:29 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 1G Sep 28 17:16:29 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:30 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 1G" returned: 0 in 0.995s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 Sep 28 17:16:30 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 is being set with open permissions: ugo+rw Sep 28 17:16:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 Sep 28 17:16:30 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97" returned: 0 in 0.464s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.333s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Creating offline snapshot b3bb9438-5add-4eb7-a82d-bc8c3a041e7b of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7bd4b6c0-b128-47e6-b38c-b20e9f586468 tempest-SnapshotsActionsTest-621291495 None] Create snapshot completed successfully Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8acc83d-78bc-43ea-a0a8-90ff3e9333ca]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:31 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:31 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-095caec7-9605-4313-9325-ff85583e3e97-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-095caec7-9605-4313-9325-ff85583e3e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:32 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.751s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-095caec7-9605-4313-9325-ff85583e3e97" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:32 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b 1G Sep 28 17:16:32 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-095caec7-9605-4313-9325-ff85583e3e97" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Deleting offline snapshot 095caec7-9605-4313-9325-ff85583e3e97 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] snapshot_file for this snap is: volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[074b18da-f4b2-472b-9b10-73fa5dedb896]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:32 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 Sep 28 17:16:32 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:32 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b 1G" returned: 0 in 0.869s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b Sep 28 17:16:33 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97" returned: 0 in 0.762s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fb367f-b52d-4406-a66c-5b9092d1ad6f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:33 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" returned: 0 in 0.537s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b is being set with open permissions: ugo+rw Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b Sep 28 17:16:33 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.478s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 Sep 28 17:16:33 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" returned: 0 in 0.303s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3cdd2827-e83f-44c9-afab-4dc39238f9df tempest-VolumesSnapshotListTestJSON-1429509923 None] Create snapshot completed successfully Sep 28 17:16:34 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97" returned: 0 in 0.527s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:34 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97 Sep 28 17:16:34 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:34 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.095caec7-9605-4313-9325-ff85583e3e97" returned: 0 in 0.424s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-095caec7-9605-4313-9325-ff85583e3e97" released by "_delete_snapshot" :: held 2.414s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_snapshot" :: held 2.483s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Created reservations ['2f0fa76d-1bd8-4d35-9df7-ad70785d69c3', '4063f18c-72fa-478b-81e2-8391e8a9926a', '4cfe7f30-8d4c-4070-933a-0c5cae551ff9', 'c5cec2b7-f2d2-4f78-9f1c-39de0895c67a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Delete snapshot completed successfully. Sep 28 17:16:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be0bca0d-dfd5-4382-96eb-c252f0db9feb tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-095caec7-9605-4313-9325-ff85583e3e97-delete_snapshot" released by "delete_snapshot" :: held 2.834s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Deleting offline snapshot b3bb9438-5add-4eb7-a82d-bc8c3a041e7b of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] snapshot_file for this snap is: volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2c7aa1-52b3-4f5e-82d4-f72d137b2e7b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Creating offline snapshot 7dfaadfb-2b48-40d7-8684-61807b495f42 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:35 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b Sep 28 17:16:35 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4eb54-29e6-4ae9-b525-4e9c43313bf0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:36 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" returned: 0 in 0.487s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fbb2e9-c8ed-4992-9dcd-8522f62ee66e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:36 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.427s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 1G Sep 28 17:16:36 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.736s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b Sep 28 17:16:36 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 1G" returned: 0 in 0.900s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 Sep 28 17:16:37 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" returned: 0 in 0.674s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b Sep 28 17:16:37 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42" returned: 0 in 0.507s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 is being set with open permissions: ugo+rw Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:37 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 Sep 28 17:16:37 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" returned: 0 in 0.365s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b" released by "_delete_snapshot" :: held 2.392s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" released by "delete_snapshot" :: held 2.423s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=88,cinder:SELECT=82,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:38 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.354s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Created reservations ['6054f6e8-b912-4ff8-a2ed-114cb1194cc2', 'a54b8b63-7082-4a99-957e-924a660db0bb', '310abb8e-2fe5-4fe5-8e6d-91142d26d489', '57962d07-fb69-4a88-b969-de2805c14d9f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-df5fa657-d0b9-45a6-9894-eb5273b3caad tempest-SnapshotsActionsTest-621291495 None] Create snapshot completed successfully Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=101,cinder:SELECT=79,cinder:INSERT=22,cinder:DELETE=11 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Delete snapshot completed successfully. Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-152aeaf3-a7c9-40f5-859d-92c05fc2ed2e tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-b3bb9438-5add-4eb7-a82d-bc8c3a041e7b-delete_snapshot" released by "delete_snapshot" :: held 2.823s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-5d756cdd-4a75-4f12-bd94-b5ea329041d8-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-5d756cdd-4a75-4f12-bd94-b5ea329041d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-5d756cdd-4a75-4f12-bd94-b5ea329041d8" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-5d756cdd-4a75-4f12-bd94-b5ea329041d8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Deleting offline snapshot 5d756cdd-4a75-4f12-bd94-b5ea329041d8 of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] snapshot_file for this snap is: volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5954ea83-f7c4-4ccf-a956-a3f648aae4bb]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:39 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:39 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-7dfaadfb-2b48-40d7-8684-61807b495f42-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-7dfaadfb-2b48-40d7-8684-61807b495f42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-7dfaadfb-2b48-40d7-8684-61807b495f42" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-7dfaadfb-2b48-40d7-8684-61807b495f42" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Deleting offline snapshot 7dfaadfb-2b48-40d7-8684-61807b495f42 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] snapshot_file for this snap is: volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[92790b16-9e2a-4a06-b4d8-48b2cd312357]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:39 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 Sep 28 17:16:39 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:39 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.834s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620928a-32c3-4641-be1e-61aeb9b9f9c9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42" returned: 0 in 0.572s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:40 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:40 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b042eb3-35f4-4a55-b43c-b8a69ecbb428]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:40 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.744s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:40 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:40 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.636s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:40 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 Sep 28 17:16:40 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.667s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:41 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8 Sep 28 17:16:41 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42" returned: 0 in 0.761s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:41 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42 Sep 28 17:16:41 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:41 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.5d756cdd-4a75-4f12-bd94-b5ea329041d8" returned: 0 in 0.372s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-5d756cdd-4a75-4f12-bd94-b5ea329041d8" released by "_delete_snapshot" :: held 2.836s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" released by "delete_snapshot" :: held 2.875s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:41 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Created reservations ['2b47fa40-3019-49a9-bd35-0345f74b619b', '68ea0d3e-2b66-4250-8aa3-e660bf58a559', '36732162-21d4-43dd-82d7-0a428e49de5e', '9a46753f-cc66-4cd1-805a-39550277f721'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:41 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.7dfaadfb-2b48-40d7-8684-61807b495f42" returned: 0 in 0.417s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-7dfaadfb-2b48-40d7-8684-61807b495f42" released by "_delete_snapshot" :: held 2.633s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Delete snapshot completed successfully. Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_snapshot" :: held 2.696s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b988a10-b496-44be-944d-265a46dd1ed1 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-5d756cdd-4a75-4f12-bd94-b5ea329041d8-delete_snapshot" released by "delete_snapshot" :: held 3.226s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Created reservations ['ac8fc4b9-a83a-492e-9434-2be57efcb141', 'f8fa25e8-8949-4220-9fac-6f99af5bceba', '6fb7a9ea-dd38-46f3-8ab9-1e0e963ad8b4', '309fa5bb-d277-49aa-b472-f8cf611fb509'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-a307f3d0-a085-4edd-816b-9d575e301c85-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-a307f3d0-a085-4edd-816b-9d575e301c85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-a307f3d0-a085-4edd-816b-9d575e301c85" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-a307f3d0-a085-4edd-816b-9d575e301c85" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Deleting offline snapshot a307f3d0-a085-4edd-816b-9d575e301c85 of volume c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] snapshot_file for this snap is: volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Delete snapshot completed successfully. Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a748ba62-de66-429a-9f08-b68dcf0c0e52 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-7dfaadfb-2b48-40d7-8684-61807b495f42-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced450dd-c6b7-4372-9309-66e1ee1c05bf]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:42 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:42 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:43 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.797s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66eff4d-6e79-4694-a85d-6f93305ba89b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[389d1472-711d-41f3-bc28-904c1855a123]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (222ecac1-09fb-4ee0-a572-5e8e39ff2491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe952b6-1d4a-47e0-9db5-5afcdadf05c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Creating offline snapshot 20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:43 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b Sep 28 17:16:43 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe952b6-1d4a-47e0-9db5-5afcdadf05c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1852111961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1b7447-eabf-4746-8084-b69ece77e465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:43Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f494f9-58bc-4e77-85c0-302e195b36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f494f9-58bc-4e77-85c0-302e195b36c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff0655-b7d1-49de-8898-fa55d14600d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ff0655-b7d1-49de-8898-fa55d14600d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1b7447-eabf-4746-8084-b69ece77e465', 'volume_name': 'volume-6d1b7447-eabf-4746-8084-b69ece77e465', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a27bed-2213-4519-b5cf-20c230a044f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a27bed-2213-4519-b5cf-20c230a044f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d85852-02f4-43c1-af02-0b6da32b0003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Volume 6d1b7447-eabf-4746-8084-b69ece77e465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1b7447-eabf-4746-8084-b69ece77e465', 'volume_size': 1} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a248c7-a0cc-4ec5-93da-f676551a2a2e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:43 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:43 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:43 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b" returned: 0 in 0.657s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:43 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:43 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.709s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 1G Sep 28 17:16:44 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.657s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85 Sep 28 17:16:44 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b.a307f3d0-a085-4edd-816b-9d575e301c85" returned: 0 in 0.436s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-a307f3d0-a085-4edd-816b-9d575e301c85" released by "_delete_snapshot" :: held 2.784s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" released by "delete_snapshot" :: held 2.833s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Created reservations ['8c63096f-6d5f-4f18-a698-69867161a54d', 'b671aad8-c493-4ef6-810a-81ead2260eb0', '28e9e6e3-070e-42da-9f44-812e9ed9d28d', 'd778c902-2169-418b-bea4-71502f08cae1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Delete snapshot completed successfully. Sep 28 17:16:45 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4530813-4559-49bc-8635-cbc938ae518f tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-a307f3d0-a085-4edd-816b-9d575e301c85-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 1G" returned: 0 in 1.019s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:45 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 Sep 28 17:16:45 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-c66eff4d-6e79-4694-a85d-6f93305ba89b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-c66eff4d-6e79-4694-a85d-6f93305ba89b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[127337e7-105a-489a-ab95-608791da1c27]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:46 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" returned: 0 in 0.697s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:46 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 is being set with open permissions: ugo+rw Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:46 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b Sep 28 17:16:46 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:46 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 Sep 28 17:16:46 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:46 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" returned: 0 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:46 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.961s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1852111961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1b7447-eabf-4746-8084-b69ece77e465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:43Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Creating volume 6d1b7447-eabf-4746-8084-b69ece77e465 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:46 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b" returned: 0 in 0.717s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:46 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 1073741824 Sep 28 17:16:46 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:46 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b Sep 28 17:16:46 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4d11c2df-7feb-4b39-838d-0fe62ed65e18 tempest-SnapshotsActionsTest-621291495 None] Create snapshot completed successfully Sep 28 17:16:47 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c66eff4d-6e79-4694-a85d-6f93305ba89b" returned: 0 in 0.395s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-quobyte-c66eff4d-6e79-4694-a85d-6f93305ba89b" released by "delete_volume" :: held 1.231s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Created reservations ['1e8f8518-0295-4761-81c6-7958d51433fa', '001f3030-a3d9-4026-98a6-886addab7e81', '453429e3-3855-4a0e-9597-2b06ec71dd24', '6ba767ad-52c8-4acf-92e1-1f24e3ca7dee'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:47 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 1073741824" returned: 0 in 0.782s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:47 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:16:47 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (4ab34391-bb9a-4faa-995c-1d7156e5f6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651f0eb3-cf56-4cda-bed6-ad3ac4444c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651f0eb3-cf56-4cda-bed6-ad3ac4444c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500876015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4427e1-49c8-42da-bf58-977efd413f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:47Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c899c9e-81b5-41d9-ad93-b5011d220308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c899c9e-81b5-41d9-ad93-b5011d220308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0596ae8b-f888-4e04-a3e0-370b067140da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0596ae8b-f888-4e04-a3e0-370b067140da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4427e1-49c8-42da-bf58-977efd413f05', 'volume_name': 'volume-ae4427e1-49c8-42da-bf58-977efd413f05', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4bbfe4-f2ea-4011-8a11-823cd8b477df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b4bbfe4-f2ea-4011-8a11-823cd8b477df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb3f412-6a00-41ec-b61e-6fdadd080bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Volume ae4427e1-49c8-42da-bf58-977efd413f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4427e1-49c8-42da-bf58-977efd413f05', 'volume_size': 1} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Acquiring lock "cinder-quobyte-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Deleting offline snapshot 20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] snapshot_file for this snap is: volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac92283-2b15-4540-a921-536260cdb41c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:47 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.500s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Deleted volume successfully. Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c2ee9002-6786-496b-b58c-4e43fec47599 tempest-VolumesSnapshotListTestJSON-1429509923 None] Lock "cinder-c66eff4d-6e79-4694-a85d-6f93305ba89b-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:47 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465" returned: 0 in 0.452s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500876015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4427e1-49c8-42da-bf58-977efd413f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:47Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Creating volume ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:47 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:16:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:48 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 Sep 28 17:16:48 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:48 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 1073741824 Sep 28 17:16:48 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d85852-02f4-43c1-af02-0b6da32b0003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1b7447-eabf-4746-8084-b69ece77e465', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1918176d-cdaa-4586-a78b-aac69936436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Volume volume-6d1b7447-eabf-4746-8084-b69ece77e465 (6d1b7447-eabf-4746-8084-b69ece77e465): created successfully Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1918176d-cdaa-4586-a78b-aac69936436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (222ecac1-09fb-4ee0-a572-5e8e39ff2491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c88c9f12-1f8e-4ac9-9955-34f3f31e1225 tempest-AttachVolumeNegativeTest-14368491 None] Created volume successfully. Sep 28 17:16:48 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" returned: 0 in 0.660s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447ca1e-4e70-4a28-befe-347624f2fc54]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:48 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:48 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:48 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 1073741824" returned: 0 in 0.936s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 Sep 28 17:16:49 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.708s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 Sep 28 17:16:49 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05" returned: 0 in 0.366s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb3f412-6a00-41ec-b61e-6fdadd080bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4427e1-49c8-42da-bf58-977efd413f05', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c75ae01-9646-452a-814c-f0651111de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Volume volume-ae4427e1-49c8-42da-bf58-977efd413f05 (ae4427e1-49c8-42da-bf58-977efd413f05): created successfully Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c75ae01-9646-452a-814c-f0651111de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (4ab34391-bb9a-4faa-995c-1d7156e5f6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c6127d5a-81b4-4651-977d-0275d3c3b79d tempest-VolumesSnapshotTestJSON-169561866 None] Created volume successfully. Sep 28 17:16:49 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" returned: 0 in 0.714s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650 Sep 28 17:16:50 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" returned: 0 in 0.552s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650" released by "_delete_snapshot" :: held 2.814s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Creating offline snapshot a79eeef7-c822-4ef4-89a4-b3b2c84ac76e of volume ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_snapshot" :: held 2.855s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[80428005-5ad8-4039-9ca2-ac2171bf3096]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Created reservations ['ce4b99fc-008a-4d76-b9d0-ad8a47943394', 'ec8e5175-cbdb-4237-9a3e-81469deaf51a', '0741f45c-e493-4575-a30a-f4a34b2e5521', '09978f5c-ae96-4a9d-a48e-df0b39c8cec7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Delete snapshot completed successfully. Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f2d4f5d1-ce1a-4ffd-b6f0-eed0546c35d5 tempest-SnapshotsActionsTest-428423472 None] Lock "cinder-20d9fa68-9eb7-4a7f-adb0-ebefbf5ff650-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:50 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 Sep 28 17:16:50 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0cf1782e-5071-43a5-8d32-732ec51fc8e8 req-f6b28b00-b6cb-4904-8dac-706efc81b96f tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:51 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05" returned: 0 in 0.611s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e 1G Sep 28 17:16:51 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "cinder-c74e92f7-535c-42a4-967f-b628160f9d19-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-c74e92f7-535c-42a4-967f-b628160f9d19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "cinder-quobyte-c74e92f7-535c-42a4-967f-b628160f9d19" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-c74e92f7-535c-42a4-967f-b628160f9d19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Deleting offline snapshot c74e92f7-535c-42a4-967f-b628160f9d19 of volume 92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] snapshot_file for this snap is: volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0859f4-8bf6-4c1e-bea2-2af208bb8775]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e 1G" returned: 0 in 0.653s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4427e1-49c8-42da-bf58-977efd413f05 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4427e1-49c8-42da-bf58-977efd413f05 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e Sep 28 17:16:51 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:52 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4427e1-49c8-42da-bf58-977efd413f05 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" returned: 0 in 0.471s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e is being set with open permissions: ugo+rw Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e Sep 28 17:16:52 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.544s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92262fb6-c21a-42eb-a312-4e2a607e4113(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b530756-266b-4ccb-bdeb-f6fc2c32de82]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 Sep 28 17:16:52 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" returned: 0 in 0.347s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info Sep 28 17:16:52 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113" returned: 0 in 0.512s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:53 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:53 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info" returned: 0 in 0.422s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info is being set with open permissions: ugo+rw Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:53 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info Sep 28 17:16:53 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.580s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:53 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.info" returned: 0 in 0.392s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:53 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19 Sep 28 17:16:53 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.109s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0cf1782e-5071-43a5-8d32-732ec51fc8e8 req-f6b28b00-b6cb-4904-8dac-706efc81b96f tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.772s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0cf1782e-5071-43a5-8d32-732ec51fc8e8 req-f6b28b00-b6cb-4904-8dac-706efc81b96f tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-0cf1782e-5071-43a5-8d32-732ec51fc8e8 req-f6b28b00-b6cb-4904-8dac-706efc81b96f tempest-AttachVolumeNegativeTest-14368491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-6d1b7447-eabf-4746-8084-b69ece77e465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '838e40ab-090a-4a89-ab90-70659832ccec', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:16:53 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-96a7969f-d160-4c28-be9b-c30958794ed5 tempest-VolumesSnapshotTestJSON-169561866 None] Create snapshot completed successfully Sep 28 17:16:53 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-0cf1782e-5071-43a5-8d32-732ec51fc8e8 req-f6b28b00-b6cb-4904-8dac-706efc81b96f tempest-AttachVolumeNegativeTest-14368491 None] attachment_update completed successfully. Sep 28 17:16:53 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113.c74e92f7-535c-42a4-967f-b628160f9d19" returned: 0 in 0.382s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-c74e92f7-535c-42a4-967f-b628160f9d19" released by "_delete_snapshot" :: held 2.230s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_snapshot" :: held 2.260s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:54 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Created reservations ['18255b64-2b89-4a48-a344-cfe59683a952', '6c701c74-f051-4d3c-a045-6e7b13b30298', 'a65a7691-7a93-43aa-955f-43cc25a022d4', '4b22e558-42b3-430e-9bdb-7659f6430a09'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Delete snapshot completed successfully. Sep 28 17:16:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a20f37d8-a667-4e8e-897b-ca4d9c0b7536 tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-c74e92f7-535c-42a4-967f-b628160f9d19-delete_snapshot" released by "delete_snapshot" :: held 2.474s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "cinder-92262fb6-c21a-42eb-a312-4e2a607e4113-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-92262fb6-c21a-42eb-a312-4e2a607e4113-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Deleting offline snapshot a79eeef7-c822-4ef4-89a4-b3b2c84ac76e of volume ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] snapshot_file for this snap is: volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802e56b-36f8-45cb-ad65-aa22dfd43d4f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" acquired by "delete_volume" :: waited 0.066s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261c5cf-95aa-4bb5-985e-51e2193956af]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:55 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e Sep 28 17:16:55 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:55 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 Sep 28 17:16:55 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:55 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae4427e1-49c8-42da-bf58-977efd413f05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4151bc-19e9-4653-9bc1-3d67dedfd861]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113" returned: 0 in 0.629s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 Sep 28 17:16:56 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:56 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113 Sep 28 17:16:56 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:56 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-92262fb6-c21a-42eb-a312-4e2a607e4113" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:56 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05" returned: 0 in 0.648s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-quobyte-92262fb6-c21a-42eb-a312-4e2a607e4113" released by "delete_volume" :: held 1.182s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:56 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e Sep 28 17:16:56 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Created reservations ['9512197d-850a-47ab-9eb7-35583af3953a', '32015288-4f26-4ad3-b737-febedd6041a8', '02f2d835-9f41-43cd-9a0c-305af0497fdb', '9dd5adf6-9d50-437a-8a58-b107aba44732'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:56 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:16:56 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" returned: 0 in 0.490s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:57 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e Sep 28 17:16:57 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:57 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Deleted volume successfully. Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b57e419c-df3f-4587-ad6b-801b7e8dcffd tempest-SnapshotsActionsTest-621291495 None] Lock "cinder-92262fb6-c21a-42eb-a312-4e2a607e4113-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:57 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05.a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" returned: 0 in 0.392s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e" released by "_delete_snapshot" :: held 2.236s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" released by "delete_snapshot" :: held 2.286s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['bc337975-8d23-4ef4-8dd3-27a700f67d03', '62624a6e-c095-46dd-9bfc-431b70b55e64', '43946e39-d5d6-457c-ab4d-bb55014bbd95', 'c048b3ef-bc36-4f95-a62a-51c4daaacaf9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Delete snapshot completed successfully. Sep 28 17:16:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2928bb4d-8c25-4343-b589-d0a149846029 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-a79eeef7-c822-4ef4-89a4-b3b2c84ac76e-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (784c5156-3a11-40c5-af82-be2aaeea7b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1000b32d-f866-404b-b385-4fd9f62909fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1000b32d-f866-404b-b385-4fd9f62909fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342884596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02698bb8-abc3-4a08-947c-5bad0972f3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:59Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffedb0f-bb07-41b7-ad5f-3b8f588ab7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffedb0f-bb07-41b7-ad5f-3b8f588ab7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f553f2-684f-46e3-98fb-34b029a215ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f553f2-684f-46e3-98fb-34b029a215ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02698bb8-abc3-4a08-947c-5bad0972f3bc', 'volume_name': 'volume-02698bb8-abc3-4a08-947c-5bad0972f3bc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dd507d-ecab-467f-869c-7eec6ea26a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dd507d-ecab-467f-869c-7eec6ea26a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffeb2d6-2347-437a-aef9-b0bf7dc2afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Volume 02698bb8-abc3-4a08-947c-5bad0972f3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02698bb8-abc3-4a08-947c-5bad0972f3bc', 'volume_size': 1} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-342884596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02698bb8-abc3-4a08-947c-5bad0972f3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:59Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Creating volume 02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:59 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:16:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:59 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc 1073741824 Sep 28 17:16:59 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc 1073741824" returned: 0 in 0.800s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:00 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:00 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 0.436s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffeb2d6-2347-437a-aef9-b0bf7dc2afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02698bb8-abc3-4a08-947c-5bad0972f3bc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dcdb0c-7ffb-4c7e-bcfa-50f950f431b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Volume volume-02698bb8-abc3-4a08-947c-5bad0972f3bc (02698bb8-abc3-4a08-947c-5bad0972f3bc): created successfully Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1dcdb0c-7ffb-4c7e-bcfa-50f950f431b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (784c5156-3a11-40c5-af82-be2aaeea7b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-93c09fd1-1c6e-410a-94e2-be6432ecc30d tempest-VolumesSnapshotTestJSON-169561866 None] Created volume successfully. Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Creating offline snapshot a33e609d-20d5-4116-8a39-b48627892fbe of volume 02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[59271a72-8ddb-404b-a695-93987ed26873]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:02 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 0.650s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe 1G Sep 28 17:17:02 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe 1G" returned: 0 in 0.676s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02698bb8-abc3-4a08-947c-5bad0972f3bc -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02698bb8-abc3-4a08-947c-5bad0972f3bc -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:03 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02698bb8-abc3-4a08-947c-5bad0972f3bc -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe is being set with open permissions: ugo+rw Sep 28 17:17:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:03 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 0.429s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info Sep 28 17:17:04 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info" returned: 0 in 0.535s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info is being set with open permissions: ugo+rw Sep 28 17:17:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info Sep 28 17:17:05 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.info" returned: 0 in 0.807s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.832s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1a269243-28ba-4fe7-a5e2-04f58b1b179c tempest-VolumesSnapshotTestJSON-169561866 None] Create snapshot completed successfully Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:07 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:17:07 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (a54f7659-d635-49f5-9ec5-6093c28c2862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a111b73-23ea-412e-8619-d01c2669c7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a111b73-23ea-412e-8619-d01c2669c7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1195042474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb24864-5705-42b8-8e7f-753b124ea103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a33e609d-20d5-4116-8a39-b48627892fbe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:08Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38564a39-c389-49a4-a91a-f46d818d7507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38564a39-c389-49a4-a91a-f46d818d7507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e38557d-4eea-4b52-9035-63227d8e875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e38557d-4eea-4b52-9035-63227d8e875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'adb24864-5705-42b8-8e7f-753b124ea103', 'volume_name': 'volume-adb24864-5705-42b8-8e7f-753b124ea103', 'volume_size': 2, 'snapshot_id': 'a33e609d-20d5-4116-8a39-b48627892fbe'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e93b0f-15e4-4754-8b80-6a259243b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e93b0f-15e4-4754-8b80-6a259243b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab68e1-fcd3-4fa7-a281-6d937db2d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:07 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Volume adb24864-5705-42b8-8e7f-753b124ea103: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-adb24864-5705-42b8-8e7f-753b124ea103', 'volume_size': 2, 'snapshot_id': 'a33e609d-20d5-4116-8a39-b48627892fbe'} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe-adb24864-5705-42b8-8e7f-753b124ea103" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe-adb24864-5705-42b8-8e7f-753b124ea103" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Creating volume adb24864-5705-42b8-8e7f-753b124ea103 from snapshot a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:17:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] snapshot: a33e609d-20d5-4116-8a39-b48627892fbe, volume: adb24864-5705-42b8-8e7f-753b124ea103, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:08 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.633s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d719f79-f20d-40b2-bea8-8f18e22aff0f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:08 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:08 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:09 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 1.045s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02698bb8-abc3-4a08-947c-5bad0972f3bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0852cb1-9d12-4498-a24b-f4d99141532f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:09 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:09 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:10 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 0.856s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:17:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:17:10 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:17:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:10 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 Sep 28 17:17:10 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:17 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=74,cinder:INSERT=20,cinder:UPDATE=75,cinder:DELETE=3 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:18 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=70,cinder:UPDATE=63,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:21 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103" returned: 0 in 11.280s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:21 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc, size 1024.00 MB, duration 11.28 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:21 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Converted 1024.00 MB image at 90.74 MB/s Sep 28 17:17:21 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 is being set with open permissions: ugo+rw Sep 28 17:17:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:21 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 Sep 28 17:17:21 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:21 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103" returned: 0 in 0.509s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" released by "_copy_volume_from_snapshot" :: held 13.924s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe-adb24864-5705-42b8-8e7f-753b124ea103" released by "_create_volume_from_snapshot" :: held 14.058s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.096s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ab68e1-fcd3-4fa7-a281-6d937db2d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb24864-5705-42b8-8e7f-753b124ea103', 'volume_size': 2, 'snapshot_id': 'a33e609d-20d5-4116-8a39-b48627892fbe'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5fdbe1-1be2-463d-a687-1f2c7d0da794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Volume volume-adb24864-5705-42b8-8e7f-753b124ea103 (adb24864-5705-42b8-8e7f-753b124ea103): created successfully Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5fdbe1-1be2-463d-a687-1f2c7d0da794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (a54f7659-d635-49f5-9ec5-6093c28c2862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d2794367-8d72-40d6-a718-2e29f7ddb265 tempest-VolumesSnapshotTestJSON-169561866 None] Created volume successfully. Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-adb24864-5705-42b8-8e7f-753b124ea103-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-adb24864-5705-42b8-8e7f-753b124ea103-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[962148b8-2d1c-43f7-a523-f320e1467cc9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:23 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 Sep 28 17:17:23 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103" returned: 0 in 0.906s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:24 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103 Sep 28 17:17:24 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:24 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-adb24864-5705-42b8-8e7f-753b124ea103" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-adb24864-5705-42b8-8e7f-753b124ea103" released by "delete_volume" :: held 1.497s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['76d8a586-e4a5-4d3f-9539-644e78b2347b', '5b3d722f-734e-411c-b88d-7a798d2fb323', '044de64c-9802-4dd9-b672-d33e39fecf9a', '8a62e78c-6316-4f95-ac80-88ac8061a3f8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:25 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:17:25 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-a33e609d-20d5-4116-8a39-b48627892fbe-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-a33e609d-20d5-4116-8a39-b48627892fbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" acquired by "delete_snapshot" :: waited 0.102s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Deleting offline snapshot a33e609d-20d5-4116-8a39-b48627892fbe of volume 02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] snapshot_file for this snap is: volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c187f7b-697e-480f-9dd9-0fab323db31a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:26 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.907s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Deleted volume successfully. Sep 28 17:17:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b34b18a-5e0f-49a9-92d7-5ad7a1a7f73d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-adb24864-5705-42b8-8e7f-753b124ea103-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:26 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:26 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:27 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 0.843s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02698bb8-abc3-4a08-947c-5bad0972f3bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:27 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[73987e55-28fe-4566-951b-5998d1acc720]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:27 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:27 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:28 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 1.189s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:28 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:28 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:29 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 0.721s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:29 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe Sep 28 17:17:29 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:29 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc.a33e609d-20d5-4116-8a39-b48627892fbe" returned: 0 in 0.585s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-a33e609d-20d5-4116-8a39-b48627892fbe" released by "_delete_snapshot" :: held 3.674s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" released by "delete_snapshot" :: held 3.750s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:29 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['f85cc2db-7436-481a-9edc-65b263163001', '9c0b99b3-d831-4e20-ac1e-a21a09fc760f', '3fef8580-3b01-4837-8d8e-42211a6cc1a6', 'fe942e36-2a47-4034-b3ca-4390246d12c3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Delete snapshot completed successfully. Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-46294eae-be02-4624-b4d5-44b8b0e3b7a0 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-a33e609d-20d5-4116-8a39-b48627892fbe-delete_snapshot" released by "delete_snapshot" :: held 4.173s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-02698bb8-abc3-4a08-947c-5bad0972f3bc-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-02698bb8-abc3-4a08-947c-5bad0972f3bc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e681c2ff-b9da-4166-88d4-abf3743b963a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:31 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:31 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 0.887s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:31 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc Sep 28 17:17:31 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:32 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-02698bb8-abc3-4a08-947c-5bad0972f3bc" returned: 0 in 0.707s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-02698bb8-abc3-4a08-947c-5bad0972f3bc" released by "delete_volume" :: held 1.754s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['79773567-b7f0-4fe2-ab29-329c1d9eff10', 'ac1232eb-d733-41a8-b7b8-36c5490b2edd', 'be1cb77f-8336-47b7-a4bb-7b168f451c8f', '5389f945-636b-41c3-a7d5-8264ef065f59'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:33 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:17:33 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Flow 'volume_create_manager' (86d02150-baca-476f-9951-70348e384984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b7965d-6b53-4bfc-aab3-7ded134d74ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b7965d-6b53-4bfc-aab3-7ded134d74ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1300518462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c0ff45-4196-4abc-8c21-ca4342f19c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7e25b014c46718e51b42b33f84e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:33Z,use_quota=True,user_id='f2065f238881478ea4c312984356cbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2c0cf3-5c8a-455b-b739-69968dc78cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2c0cf3-5c8a-455b-b739-69968dc78cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338f075a-2829-49e1-857c-2f16bfb82783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338f075a-2829-49e1-857c-2f16bfb82783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c0ff45-4196-4abc-8c21-ca4342f19c39', 'volume_name': 'volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a02219-dd15-49df-946d-1d56f8cf079d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:33 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2a02219-dd15-49df-946d-1d56f8cf079d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5196b257-6c29-41da-82db-433578854d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume b7c0ff45-4196-4abc-8c21-ca4342f19c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39', 'volume_size': 1} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1300518462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c0ff45-4196-4abc-8c21-ca4342f19c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7e25b014c46718e51b42b33f84e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:33Z,use_quota=True,user_id='f2065f238881478ea4c312984356cbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Creating volume b7c0ff45-4196-4abc-8c21-ca4342f19c39 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:33 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.549s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Deleted volume successfully. Sep 28 17:17:33 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 1073741824 Sep 28 17:17:33 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c026cad8-78c2-4e6f-bd1f-979522c41c1d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-02698bb8-abc3-4a08-947c-5bad0972f3bc-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:34 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 1073741824" returned: 0 in 1.040s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:34 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 Sep 28 17:17:34 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:34 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (f7ebcd4f-e24a-461c-accc-89ec9ede34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18fe2ba-c7ff-4257-8191-748c2cfcd458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18fe2ba-c7ff-4257-8191-748c2cfcd458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1155909538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:35Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244b557c-59d7-4b13-ab6a-299bcad69258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244b557c-59d7-4b13-ab6a-299bcad69258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a4717b-ebb5-4666-9c4c-281439d6beac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a4717b-ebb5-4666-9c4c-281439d6beac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af', 'volume_name': 'volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbdaa2-d47c-4c6d-bcfe-173f3f46494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbdaa2-d47c-4c6d-bcfe-173f3f46494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e787f8-9607-4262-b828-b248e0df9860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Volume 8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af', 'volume_size': 1} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:35 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39" returned: 0 in 0.607s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1155909538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:35Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Creating volume 8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:35 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5196b257-6c29-41da-82db-433578854d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af 1073741824 Sep 28 17:17:35 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57f7193-d697-4084-a091-029393e1c29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 (b7c0ff45-4196-4abc-8c21-ca4342f19c39): created successfully Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57f7193-d697-4084-a091-029393e1c29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Flow 'volume_create_manager' (86d02150-baca-476f-9951-70348e384984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e2f28239-f8f1-4a21-b425-5a9e3fe1acd9 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Created volume successfully. Sep 28 17:17:35 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af 1073741824" returned: 0 in 0.676s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:17:36 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:36 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 0.340s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e787f8-9607-4262-b828-b248e0df9860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45436ef8-e05f-430f-9113-c1e1ff9e6167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Volume volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af (8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af): created successfully Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45436ef8-e05f-430f-9113-c1e1ff9e6167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (f7ebcd4f-e24a-461c-accc-89ec9ede34c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-064b6697-dd75-4042-a113-2c3ea23516c4 tempest-VolumesSnapshotTestJSON-169561866 None] Created volume successfully. Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "cinder-b7c0ff45-4196-4abc-8c21-ca4342f19c39-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "cinder-b7c0ff45-4196-4abc-8c21-ca4342f19c39-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "cinder-quobyte-b7c0ff45-4196-4abc-8c21-ca4342f19c39" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "cinder-quobyte-b7c0ff45-4196-4abc-8c21-ca4342f19c39" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f6938e-b245-4c2c-ab1e-1959c9ac7cc5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 Sep 28 17:17:37 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Creating offline snapshot f027cce9-0658-485e-a15d-b1c4985b7dc6 of volume 8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ccdc41-8876-4aef-ba06-857414f652f1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39" returned: 0 in 0.778s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39 Sep 28 17:17:37 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:17:37 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b7c0ff45-4196-4abc-8c21-ca4342f19c39" returned: 0 in 0.451s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "cinder-quobyte-b7c0ff45-4196-4abc-8c21-ca4342f19c39" released by "delete_volume" :: held 1.348s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Created reservations ['9dcc6c33-fade-430b-9bda-68a1eb68c033', '58b95676-731b-44a7-b0ff-ddac342c3211', '7504dc50-c75c-485b-b80d-afb8a80408b7', 'a471798e-6019-48f5-a3a4-09b326753374'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:38 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 0.738s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 1G Sep 28 17:17:38 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:38 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:17:38 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:38 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.456s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Deleted volume successfully. Sep 28 17:17:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-120e3085-2ea9-48cc-86da-bb802f93b84a tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "cinder-b7c0ff45-4196-4abc-8c21-ca4342f19c39-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:39 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 1G" returned: 0 in 1.145s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:17:39 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:39 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:39 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 is being set with open permissions: ugo+rw Sep 28 17:17:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:39 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:17:39 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.341s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:40 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info Sep 28 17:17:40 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Flow 'volume_create_manager' (c0a277d7-cea9-4b7e-bff0-b8d63e880506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0388396b-8be1-42e4-bdda-214d1b898bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0388396b-8be1-42e4-bdda-214d1b898bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-633205641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7e25b014c46718e51b42b33f84e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:40Z,use_quota=True,user_id='f2065f238881478ea4c312984356cbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5133fc01-824b-41e9-9e0b-4d18b9248ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5133fc01-824b-41e9-9e0b-4d18b9248ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab27d07-3b2a-45cc-b086-ca2a4b511326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab27d07-3b2a-45cc-b086-ca2a4b511326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4', 'volume_name': 'volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608155dd-ae5c-4ee5-b67c-54594df37d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608155dd-ae5c-4ee5-b67c-54594df37d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5b13f3-8f6f-4d34-a225-d784db610634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume 2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4', 'volume_size': 1} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:40 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info" returned: 0 in 0.365s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info is being set with open permissions: ugo+rw Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:40 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info Sep 28 17:17:40 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (5b7c31f9-d834-4c57-83c2-11a2be6139b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e82f440-1a84-4449-9ccc-f33abbfe07fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e82f440-1a84-4449-9ccc-f33abbfe07fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1404854176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b006a2ef-e296-4786-b04e-458f3b1ac273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:41Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3982f30-27e2-4228-a887-cbae2a6673b2),volume_type_id=e3982f30-27e2-4228-a887-cbae2a6673b2)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d394aa4-8e45-447c-88c6-a04a318cd1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d394aa4-8e45-447c-88c6-a04a318cd1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1914ce-89e2-4b94-9b60-1afc0f4c25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1914ce-89e2-4b94-9b60-1afc0f4c25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b006a2ef-e296-4786-b04e-458f3b1ac273', 'volume_name': 'volume-b006a2ef-e296-4786-b04e-458f3b1ac273', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99d570d-d788-4269-aaf2-451afe48ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99d570d-d788-4269-aaf2-451afe48ab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5935ce1-22a4-48c2-98fe-9f930544f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume b006a2ef-e296-4786-b04e-458f3b1ac273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b006a2ef-e296-4786-b04e-458f3b1ac273', 'volume_size': 1} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:40 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.info" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.628s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-633205641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de7e25b014c46718e51b42b33f84e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:40Z,use_quota=True,user_id='f2065f238881478ea4c312984356cbe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Creating volume 2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:40 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-41563021-cec7-4522-b349-1d2c93516f3b tempest-VolumesSnapshotTestJSON-169561866 None] Create snapshot completed successfully Sep 28 17:17:41 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 1073741824 Sep 28 17:17:41 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (d9d300e8-b0b8-4ee1-8796-09b9b3c58bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3560e91-e6ea-4334-a49e-b04a114cc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3560e91-e6ea-4334-a49e-b04a114cc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-915593270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0443040d-cfbe-4fff-8586-fc42529ca160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:41Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e02f96c-ffb5-4486-9cdf-63f51f89243d),volume_type_id=6e02f96c-ffb5-4486-9cdf-63f51f89243d)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee273e-7385-44cf-94e3-6a0f481ce3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ee273e-7385-44cf-94e3-6a0f481ce3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfba315b-25dc-4a75-9172-4013a2a66aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfba315b-25dc-4a75-9172-4013a2a66aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0443040d-cfbe-4fff-8586-fc42529ca160', 'volume_name': 'volume-0443040d-cfbe-4fff-8586-fc42529ca160', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f333e-bad1-418c-be0c-4858b5299e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2f333e-bad1-418c-be0c-4858b5299e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a160415-4f5e-4833-bf8b-84db28ac19e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume 0443040d-cfbe-4fff-8586-fc42529ca160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0443040d-cfbe-4fff-8586-fc42529ca160', 'volume_size': 1} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:41 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 1073741824" returned: 0 in 0.811s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:41 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 Sep 28 17:17:41 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:42 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" returned: 0 in 0.377s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1404854176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b006a2ef-e296-4786-b04e-458f3b1ac273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:41Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3982f30-27e2-4228-a887-cbae2a6673b2),volume_type_id=e3982f30-27e2-4228-a887-cbae2a6673b2)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Creating volume b006a2ef-e296-4786-b04e-458f3b1ac273 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:42 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5b13f3-8f6f-4d34-a225-d784db610634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418509b5-386e-41de-a40c-3cf7cf63fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 1073741824 Sep 28 17:17:42 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Volume volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 (2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4): created successfully Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418509b5-386e-41de-a40c-3cf7cf63fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Flow 'volume_create_manager' (c0a277d7-cea9-4b7e-bff0-b8d63e880506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cc4636db-1408-488a-b451-8ca787edad28 tempest-VolumeQuotasAdminTestJSON-1608404677 None] Created volume successfully. Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (7ca1522c-dfe2-4838-9fe3-8afd81bb3b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056fccf2-97c3-4271-baf3-5771b781f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056fccf2-97c3-4271-baf3-5771b781f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-194312077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7a3869-943a-488e-83e7-0bdf4d94cc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aff2fdb5840241a9962e4b398e51decb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f027cce9-0658-485e-a15d-b1c4985b7dc6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:43Z,use_quota=True,user_id='e27bfa083c484d81968f75cd381378f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113f94eb-3d36-44c4-b1b5-646b1558e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113f94eb-3d36-44c4-b1b5-646b1558e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a097f2-8cdd-4550-ac50-8ab723e00796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a097f2-8cdd-4550-ac50-8ab723e00796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e7a3869-943a-488e-83e7-0bdf4d94cc0c', 'volume_name': 'volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c', 'volume_size': 1, 'snapshot_id': 'f027cce9-0658-485e-a15d-b1c4985b7dc6'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b91b1f-9b1f-4466-b0d3-9a5c8939fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b91b1f-9b1f-4466-b0d3-9a5c8939fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ada6ff-793a-4762-83a2-91ae8a206dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Volume 5e7a3869-943a-488e-83e7-0bdf4d94cc0c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c', 'volume_size': 1, 'snapshot_id': 'f027cce9-0658-485e-a15d-b1c4985b7dc6'} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:42 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (11f41c21-c02b-4c04-932d-d800f13ea0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1485d5-1afc-423c-8b7a-6634387dcb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 1073741824" returned: 0 in 0.614s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1485d5-1afc-423c-8b7a-6634387dcb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1977021975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee150beb-ef67-47ce-85d4-aecc9773ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:43Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2887f8e-abc8-41ee-8502-f828ffb95352),volume_type_id=f2887f8e-abc8-41ee-8502-f828ffb95352)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ade2ad-cb37-4bf6-acae-289d936c1de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ade2ad-cb37-4bf6-acae-289d936c1de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3236d702-47e9-4512-8725-ce041e15aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:17:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:42 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 Sep 28 17:17:42 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3236d702-47e9-4512-8725-ce041e15aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee150beb-ef67-47ce-85d4-aecc9773ddb4', 'volume_name': 'volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4', 'volume_size': 1, 'image_id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1745553000', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ac4d6242f8c4dbfa8113738b4fed45a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd11634-8d28-4479-8516-20d1b5c9a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd11634-8d28-4479-8516-20d1b5c9a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807cad55-7a7d-4c73-836a-18b39083df38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume ee150beb-ef67-47ce-85d4-aecc9773ddb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4', 'volume_size': 1, 'image_id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1745553000', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ac4d6242f8c4dbfa8113738b4fed45a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4/file', 'properties': {}}, 'image_service': } Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Trying to clone ee150beb-ef67-47ce-85d4-aecc9773ddb4 from image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:17:43 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-915593270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0443040d-cfbe-4fff-8586-fc42529ca160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:41Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e02f96c-ffb5-4486-9cdf-63f51f89243d),volume_type_id=6e02f96c-ffb5-4486-9cdf-63f51f89243d)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Creating volume 0443040d-cfbe-4fff-8586-fc42529ca160 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:43 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5935ce1-22a4-48c2-98fe-9f930544f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b006a2ef-e296-4786-b04e-458f3b1ac273', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bc44e8-1be6-4136-a2d8-ec12724a844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:43 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 1073741824 Sep 28 17:17:43 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume volume-b006a2ef-e296-4786-b04e-458f3b1ac273 (b006a2ef-e296-4786-b04e-458f3b1ac273): created successfully Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bc44e8-1be6-4136-a2d8-ec12724a844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (5b7c31f9-d834-4c57-83c2-11a2be6139b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-687590cd-8000-44de-96c7-3a273e8f3870 tempest-TestInstancesWithCinderVolumes-366036918 None] Created volume successfully. Sep 28 17:17:44 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 1073741824" returned: 0 in 0.737s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:44 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 Sep 28 17:17:44 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:44 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160" returned: 0 in 0.363s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.793s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Creating volume 5e7a3869-943a-488e-83e7-0bdf4d94cc0c from snapshot f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a160415-4f5e-4833-bf8b-84db28ac19e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0443040d-cfbe-4fff-8586-fc42529ca160', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0caa3a-7452-4bd3-a641-cf7f933687da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6720acef-36ea-4d57-bf66-1815620880a5 tempest-VolumeQuotasAdminTestJSON-246523516 None] Transfer volume completed successfully. Sep 28 17:17:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume volume-0443040d-cfbe-4fff-8586-fc42529ca160 (0443040d-cfbe-4fff-8586-fc42529ca160): created successfully Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0caa3a-7452-4bd3-a641-cf7f933687da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (d9d300e8-b0b8-4ee1-8796-09b9b3c58bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" acquired by "_copy_volume_from_snapshot" :: waited 0.081s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] snapshot: f027cce9-0658-485e-a15d-b1c4985b7dc6, volume: 5e7a3869-943a-488e-83e7-0bdf4d94cc0c, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:17:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4ad82b75-b9ec-4fb6-a440-57fb137be4e7 tempest-TestInstancesWithCinderVolumes-366036918 None] Created volume successfully. Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[68145750-17af-484d-9242-5d2baff04848]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:44 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:17:44 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.537s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c33f4-5549-4caf-acd8-46f91050f2e2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Acquiring lock "cinder-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "cinder-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Acquiring lock "cinder-quobyte-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "cinder-quobyte-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:45 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:17:45 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11285c4-4f75-4789-9daf-bad2d2fac447]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 Sep 28 17:17:45 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 0.532s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:17:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c Sep 28 17:17:45 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:46 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4 Sep 28 17:17:46 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" returned: 0 in 0.509s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "cinder-quobyte-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4" released by "delete_volume" :: held 1.152s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Created reservations ['facb44e3-7c47-4040-9b2f-66e23303c432', '58946f84-2c63-4253-8623-5059630f3097', 'f4f57ca9-4fa0-496a-8ac0-8e656360eac0', 'd3e28e81-0475-4afa-9183-8c1dcc170ac0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:47 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:17:47 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:47 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.657s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Deleted volume successfully. Sep 28 17:17:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-af751b1d-0638-40d0-8302-aabdd2747511 tempest-VolumeQuotasAdminTestJSON-852440085 None] Lock "cinder-2a9e0d03-5577-4e7f-a3f2-3db8dffe26d4-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:51 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD, size 20.69 MB, duration 8.10 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:17:51 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Image download 20.69 MB at 2.56 MB/s Sep 28 17:17:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106a893-c112-4d1f-8d45-6274d551c80e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:51 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD Sep 28 17:17:51 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:52 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD" returned: 0 in 1.124s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:52 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Temporary image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 is fetched for user f46e0b0c82124541bf9f3b66b9543cf1. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:17:52 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333220b-feb3-4792-ba35-1a6146ef24c4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:53 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD Sep 28 17:17:53 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:54 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD" returned: 0 in 1.206s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:57 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" returned: 0 in 11.232s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af, size 1024.00 MB, duration 11.23 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:57 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Converted 1024.00 MB image at 91.16 MB/s Sep 28 17:17:57 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c is being set with open permissions: ugo+rw Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:57 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c Sep 28 17:17:57 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:57 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" returned: 0 in 0.407s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" released by "_copy_volume_from_snapshot" :: held 12.863s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" released by "_create_volume_from_snapshot" :: held 13.047s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.084s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.447s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1977021975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee150beb-ef67-47ce-85d4-aecc9773ddb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac4d6242f8c4dbfa8113738b4fed45a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:43Z,use_quota=True,user_id='f46e0b0c82124541bf9f3b66b9543cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2887f8e-abc8-41ee-8502-f828ffb95352),volume_type_id=f2887f8e-abc8-41ee-8502-f828ffb95352)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Creating volume ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:57 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:57 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1073741824 Sep 28 17:17:57 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ada6ff-793a-4762-83a2-91ae8a206dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c', 'volume_size': 1, 'snapshot_id': 'f027cce9-0658-485e-a15d-b1c4985b7dc6'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2971e06-32e1-47e4-9878-c9484d93e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Volume volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c (5e7a3869-943a-488e-83e7-0bdf4d94cc0c): created successfully Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2971e06-32e1-47e4-9878-c9484d93e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Flow 'volume_create_manager' (7ca1522c-dfe2-4838-9fe3-8afd81bb3b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b69a7739-ee60-46e2-80ff-55c1e18d3dd6 tempest-VolumesSnapshotTestJSON-169561866 None] Created volume successfully. Sep 28 17:17:58 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-5e7a3869-943a-488e-83e7-0bdf4d94cc0c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1073741824" returned: 0 in 0.797s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-5e7a3869-943a-488e-83e7-0bdf4d94cc0c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:58 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 Sep 28 17:17:58 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60c2bc-7e49-40b6-913d-415ffeeb861d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c Sep 28 17:17:58 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:58 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Attempting download of 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}])) to volume ee150beb-ef67-47ce-85d4-aecc9773ddb4. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7e9e3-518c-4f05-b48c-e3f3443c5457]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth Sep 28 17:17:59 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" returned: 0 in 0.707s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c Sep 28 17:17:59 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth" returned: 0 in 0.575s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth Sep 28 17:17:59 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" returned: 0 in 0.509s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-5e7a3869-943a-488e-83e7-0bdf4d94cc0c" released by "delete_volume" :: held 1.332s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['b8b50ea7-cbe6-4c02-822a-0996231a7483', 'eff8a5b5-8a36-43e8-9c26-b59fa1d5e569', 'ff0603f8-7930-4b91-8323-99d74026b3e2', '6487cd69-8227-4b12-9129-c84cf8bc001d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth" returned: 1 in 0.576s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_5h9_yoth' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[581bac80-df82-4a1c-ba8e-fa4d36276b7b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:00 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD Sep 28 17:18:00 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.347s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Deleted volume successfully. Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-43a93e66-ea89-4d97-a415-d26f7ae6187d tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-5e7a3869-943a-488e-83e7-0bdf4d94cc0c-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:18:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 Sep 28 17:18:00 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-f027cce9-0658-485e-a15d-b1c4985b7dc6-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-f027cce9-0658-485e-a15d-b1c4985b7dc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Deleting offline snapshot f027cce9-0658-485e-a15d-b1c4985b7dc6 of volume 8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] snapshot_file for this snap is: volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f28527c-200f-4623-8b73-62249f218d62]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:18:01 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:01 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.601s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a3d44b-d006-4ae2-8b3b-56237dacc353]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-10c621f8-13f1-42bb-88fa-18454423b006 req-94d365e8-0ca1-49a2-ab22-ec2af56ed1fb tempest-AttachVolumeNegativeTest-14368491 None] Terminate volume connection completed successfully. Sep 28 17:18:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-10c621f8-13f1-42bb-88fa-18454423b006 req-94d365e8-0ca1-49a2-ab22-ec2af56ed1fb tempest-AttachVolumeNegativeTest-14368491 None] Deleting attachment 838e40ab-090a-4a89-ab90-70659832ccec. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:18:02 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:18:02 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:03 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 1.143s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:03 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:18:03 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:03 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.880s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6 Sep 28 17:18:04 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af.f027cce9-0658-485e-a15d-b1c4985b7dc6" returned: 0 in 0.458s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4" returned: 0 in 3.646s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a972559-8eb4-42c7-b5d5-9d085e33c3d4_b05gpkiidevstack@QuobyteHD, size 112.00 MB, duration 3.65 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:18:04 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Converted 112.00 MB image at 30.70 MB/s Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-f027cce9-0658-485e-a15d-b1c4985b7dc6" released by "_delete_snapshot" :: held 3.308s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" released by "delete_snapshot" :: held 3.344s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:04 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1G Sep 28 17:18:04 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['f8c2b74d-3cd3-47ee-810d-c52ab56a0751', 'c0bcdcec-1f22-4b8b-a138-dc79ff4037d7', 'a681f242-15c8-4194-83ef-758edbd89f2a', '3d23a62c-0aec-4293-bcf3-30d8c30317fc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Delete snapshot completed successfully. Sep 28 17:18:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a7ce56be-71c2-43ae-8732-6c8f97f5107b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-f027cce9-0658-485e-a15d-b1c4985b7dc6-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:05 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 1G" returned: 0 in 0.625s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Downloaded image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}])) to volume ee150beb-ef67-47ce-85d4-aecc9773ddb4 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Temporary image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 for user f46e0b0c82124541bf9f3b66b9543cf1 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Marking volume ee150beb-ef67-47ce-85d4-aecc9773ddb4 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Copying metadata from image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 to ee150beb-ef67-47ce-85d4-aecc9773ddb4. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Creating volume glance metadata for volume ee150beb-ef67-47ce-85d4-aecc9773ddb4 backed by image 1a972559-8eb4-42c7-b5d5-9d085e33c3d4 with: {'image_id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'image_name': 'tempest-scenario-img--1745553000', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807cad55-7a7d-4c73-836a-18b39083df38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4', 'volume_size': 1, 'image_id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1745553000', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ac4d6242f8c4dbfa8113738b4fed45a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1a972559-8eb4-42c7-b5d5-9d085e33c3d4', 'created_at': datetime.datetime(2026, 9, 28, 15, 17, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a972559-8eb4-42c7-b5d5-9d085e33c3d4/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6bb64-feb0-4a5f-ace9-4ecd39cdf8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Volume volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 (ee150beb-ef67-47ce-85d4-aecc9773ddb4): created successfully Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f6bb64-feb0-4a5f-ace9-4ecd39cdf8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Flow 'volume_create_manager' (11f41c21-c02b-4c04-932d-d800f13ea0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-938a195e-4d5e-4f84-909e-b720067277c1 tempest-TestInstancesWithCinderVolumes-366036918 None] Created volume successfully. Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a90fff-7b3a-49a7-b852-8da3b1a6c1f6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:18:06 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:06 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 0.648s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af Sep 28 17:18:06 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:06 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" returned: 0 in 0.351s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af" released by "delete_volume" :: held 1.130s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['d0c24f0a-8306-4146-8468-650b856925e6', '8c92409b-4f56-4032-85e9-262a9c470e9d', '4d30826d-cb91-44ac-9dc0-67fbac0e3fd6', 'b8fa95cf-7b1d-4477-923f-39a195d241d2'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:07 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:07 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.532s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Deleted volume successfully. Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Flow 'volume_create_manager' (89ce5903-df76-4f06-aa8a-f84debb9ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae5200f-82e3-4ac5-8792-6957f0cb8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-102dc8fe-c64a-412c-ad66-04d6d64d3c18 tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-8fd4dbe6-f98b-45d9-9ce4-0ce738fcf0af-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae5200f-82e3-4ac5-8792-6957f0cb8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-357339600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f8ac90-3f3f-4bb6-879a-43586c15d1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3335ff1d7be43b8b95af956d3b0496d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:08Z,use_quota=True,user_id='438cbb9bcdc14803b06d0758bb70ee19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de2b802d-ffde-421c-866f-6a0ca629077e),volume_type_id=de2b802d-ffde-421c-866f-6a0ca629077e)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159d91c3-3da0-454a-8912-ca6864cfb09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159d91c3-3da0-454a-8912-ca6864cfb09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c81cb2-36dd-4a94-855d-79a1d0534302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c81cb2-36dd-4a94-855d-79a1d0534302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f8ac90-3f3f-4bb6-879a-43586c15d1b8', 'volume_name': 'volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab88fc-b8e1-46b3-9c1d-c53d2d55269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ab88fc-b8e1-46b3-9c1d-c53d2d55269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f4b9b-1b10-4091-956f-9f82e7889138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:08 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Volume a2f8ac90-3f3f-4bb6-879a-43586c15d1b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8', 'volume_size': 1} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-357339600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f8ac90-3f3f-4bb6-879a-43586c15d1b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3335ff1d7be43b8b95af956d3b0496d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:08Z,use_quota=True,user_id='438cbb9bcdc14803b06d0758bb70ee19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de2b802d-ffde-421c-866f-6a0ca629077e),volume_type_id=de2b802d-ffde-421c-866f-6a0ca629077e)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Creating volume a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:08 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:08 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.521s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 1073741824 Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:08 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-ae4427e1-49c8-42da-bf58-977efd413f05-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-ae4427e1-49c8-42da-bf58-977efd413f05-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c712d0-5413-40f7-b2d5-20f1e5ea89b8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 Sep 28 17:18:08 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 1073741824" returned: 0 in 0.778s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 Sep 28 17:18:08 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:09 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05" returned: 0 in 0.807s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:09 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05 Sep 28 17:18:09 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:09 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" returned: 0 in 0.426s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531f4b9b-1b10-4091-956f-9f82e7889138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ec7d0b-579f-4cc7-896b-ffaaf1203b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Volume volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 (a2f8ac90-3f3f-4bb6-879a-43586c15d1b8): created successfully Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ec7d0b-579f-4cc7-896b-ffaaf1203b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Flow 'volume_create_manager' (89ce5903-df76-4f06-aa8a-f84debb9ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ac236e12-a59d-402d-bd7e-cda01d5af67d tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Created volume successfully. Sep 28 17:18:09 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ae4427e1-49c8-42da-bf58-977efd413f05" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-quobyte-ae4427e1-49c8-42da-bf58-977efd413f05" released by "delete_volume" :: held 1.373s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:09 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Created reservations ['bf15b6da-4d16-4398-8531-421b871e6aa7', 'e102be6f-d36b-416d-9019-c55f24b0eb1a', '594070f2-823b-4848-96c3-72aebf6c0022', '29ce3601-6b9c-489e-8a15-64068066c6df'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:10 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:10 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-9f44aa17-d9c4-4b91-a2cd-1f5725edb037 req-7c69cd44-c930-4a45-9cd1-e1aeed255110 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-9f44aa17-d9c4-4b91-a2cd-1f5725edb037 req-7c69cd44-c930-4a45-9cd1-e1aeed255110 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-9f44aa17-d9c4-4b91-a2cd-1f5725edb037 req-7c69cd44-c930-4a45-9cd1-e1aeed255110 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-9f44aa17-d9c4-4b91-a2cd-1f5725edb037 req-7c69cd44-c930-4a45-9cd1-e1aeed255110 tempest-TestInstancesWithCinderVolumes-366036918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bea9f3d7-1a60-4b58-851a-8087b58881ff', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:18:10 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.559s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Deleted volume successfully. Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b04ecce8-705b-4b06-927e-bddb11c75f7b tempest-VolumesSnapshotTestJSON-169561866 None] Lock "cinder-ae4427e1-49c8-42da-bf58-977efd413f05-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-9f44aa17-d9c4-4b91-a2cd-1f5725edb037 req-7c69cd44-c930-4a45-9cd1-e1aeed255110 tempest-TestInstancesWithCinderVolumes-366036918 None] attachment_update completed successfully. Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:10 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:10 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:11 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.447s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:11 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-07ce9838-8af2-4bd3-ac11-1965efbc0915 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Retype volume completed successfully. Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "cinder-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "cinder-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "cinder-quobyte-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "cinder-quobyte-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33c0a3d-1e80-48c7-9e5c-e7d4731a4e05]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:12 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 Sep 28 17:18:12 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:12 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" returned: 0 in 0.626s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:12 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8 Sep 28 17:18:12 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" returned: 0 in 0.408s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "cinder-quobyte-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8" released by "delete_volume" :: held 1.112s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:13 devstack cinder-volume[86929]: WARNING cinder.quota [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:13 devstack cinder-volume[86929]: WARNING cinder.quota [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Created reservations ['5e2e7fe9-ea48-4f43-8d05-086ea9e3347f', 'f23cec52-bea7-4440-bd98-c3ca6dc6a751', 'd4db7685-2a15-409a-ac0b-4ebe91b9f1b6', '9055adfd-5aa1-4f8a-b2d1-019b9189deb8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:13 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:18:13 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:13 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.372s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:13 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Deleted volume successfully. Sep 28 17:18:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9f7dcc95-b789-4db5-ac64-91023b569b88 tempest-VolumeRetypeWithoutMigrationTest-664397174 None] Lock "cinder-a2f8ac90-3f3f-4bb6-879a-43586c15d1b8-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:23 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=93,cinder:INSERT=34,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:23 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=95,cinder:UPDATE=107,cinder:DELETE=12,cinder:INSERT=25 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-745083e3-5154-43ba-8e20-167c3e654b67 req-ec7d30c3-6c92-471b-9acd-fdcdce82dab8 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-745083e3-5154-43ba-8e20-167c3e654b67 req-ec7d30c3-6c92-471b-9acd-fdcdce82dab8 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-745083e3-5154-43ba-8e20-167c3e654b67 req-ec7d30c3-6c92-471b-9acd-fdcdce82dab8 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-745083e3-5154-43ba-8e20-167c3e654b67 req-ec7d30c3-6c92-471b-9acd-fdcdce82dab8 tempest-TestInstancesWithCinderVolumes-366036918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-b006a2ef-e296-4786-b04e-458f3b1ac273', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b626913-5c24-4882-8b46-5da08e4bd14e', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-745083e3-5154-43ba-8e20-167c3e654b67 req-ec7d30c3-6c92-471b-9acd-fdcdce82dab8 tempest-TestInstancesWithCinderVolumes-366036918 None] attachment_update completed successfully. Sep 28 17:19:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-41041630-aed6-4273-84d1-af9cd6ba1a38 req-3046b71e-90ee-4989-81a9-0f8b9f4bc2ca tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-41041630-aed6-4273-84d1-af9cd6ba1a38 req-3046b71e-90ee-4989-81a9-0f8b9f4bc2ca tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-41041630-aed6-4273-84d1-af9cd6ba1a38 req-3046b71e-90ee-4989-81a9-0f8b9f4bc2ca tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-41041630-aed6-4273-84d1-af9cd6ba1a38 req-3046b71e-90ee-4989-81a9-0f8b9f4bc2ca tempest-TestInstancesWithCinderVolumes-366036918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-0443040d-cfbe-4fff-8586-fc42529ca160', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0cf580b-a3bf-41a3-8edb-05d210114e40', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-41041630-aed6-4273-84d1-af9cd6ba1a38 req-3046b71e-90ee-4989-81a9-0f8b9f4bc2ca tempest-TestInstancesWithCinderVolumes-366036918 None] attachment_update completed successfully. Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:07 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:07 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:07 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:13 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-d5594666-943b-4a74-a16a-2c6e34141f09 req-503c35b4-8ef9-477d-a127-aabcc82eb783 tempest-TestInstancesWithCinderVolumes-366036918 None] Terminate volume connection completed successfully. Sep 28 17:19:13 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-d5594666-943b-4a74-a16a-2c6e34141f09 req-503c35b4-8ef9-477d-a127-aabcc82eb783 tempest-TestInstancesWithCinderVolumes-366036918 None] Deleting attachment 6b626913-5c24-4882-8b46-5da08e4bd14e. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-b006a2ef-e296-4786-b04e-458f3b1ac273-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-b006a2ef-e296-4786-b04e-458f3b1ac273-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-quobyte-b006a2ef-e296-4786-b04e-458f3b1ac273" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-b006a2ef-e296-4786-b04e-458f3b1ac273" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3251d0a0-1560-447a-9ad8-cc33eafc5001]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:14 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 Sep 28 17:19:14 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273" returned: 0 in 0.818s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273 Sep 28 17:19:15 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b006a2ef-e296-4786-b04e-458f3b1ac273" returned: 0 in 0.584s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-b006a2ef-e296-4786-b04e-458f3b1ac273" released by "delete_volume" :: held 1.526s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1295110151-828372632 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1295110151-828372632, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:16 devstack cinder-volume[86929]: WARNING cinder.quota [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1295110151-828372632 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1295110151-828372632, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Created reservations ['032b3f3b-0ec4-4918-89a9-97fa41556d0f', '5b29b152-c153-421e-963c-171b3507672f', 'e6eb4af3-4877-40a6-a615-e5d3653882d9', '8768d67c-c136-44b6-8d5f-227a21c1769a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:16 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:16 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (6395cad8-0423-450a-937a-bb6e805bae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41798b2c-4921-4582-aca9-22b0f39f8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41798b2c-4921-4582-aca9-22b0f39f8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1634771912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:16Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce3f6a4-a02e-4aed-81ac-13179c5b27a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce3f6a4-a02e-4aed-81ac-13179c5b27a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4001cdcd-ed7a-44a6-96fa-3339b4794bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4001cdcd-ed7a-44a6-96fa-3339b4794bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f', 'volume_name': 'volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b4a063-e110-416c-b4c7-2ba7fc6fa5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b4a063-e110-416c-b4c7-2ba7fc6fa5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d36d7-10c2-4c13-835f-7d1ccb79f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Volume bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f', 'volume_size': 1} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1634771912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:16Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Creating volume bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:16 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:16 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:16 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f 1073741824 Sep 28 17:19:16 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.497s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Deleted volume successfully. Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Flow 'volume_create_manager' (3899a635-8383-404c-b29a-706b057c20d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28564fc2-4e42-4dad-8a96-8f6299d727b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28564fc2-4e42-4dad-8a96-8f6299d727b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1264163933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e84c08-b1b9-457e-909c-98049705774f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ffcbbdeb63462fb875353683b9b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:17Z,use_quota=True,user_id='58353c101b894c40b3bcac7a4e1aa4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362665a-3cb2-4af5-b999-398f3e2e0c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362665a-3cb2-4af5-b999-398f3e2e0c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d00f38-28e5-44e3-a299-4dc300f878bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d00f38-28e5-44e3-a299-4dc300f878bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e84c08-b1b9-457e-909c-98049705774f', 'volume_name': 'volume-17e84c08-b1b9-457e-909c-98049705774f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff3d549-6856-4d78-85ca-41c4e0710f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff3d549-6856-4d78-85ca-41c4e0710f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0850b5-c073-4e36-b6a8-a57116a26042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume 17e84c08-b1b9-457e-909c-98049705774f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e84c08-b1b9-457e-909c-98049705774f', 'volume_size': 1} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-37df7432-e41b-4401-a8c3-05f50b66f6a0 tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-b006a2ef-e296-4786-b04e-458f3b1ac273-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f 1073741824" returned: 0 in 0.877s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Flow 'volume_create_manager' (3055acf1-0a43-4d3e-bf0f-ba09ed27bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc43d31-550e-44c5-b35c-8df5e7df3c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc43d31-550e-44c5-b35c-8df5e7df3c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-580123540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a4e955-fe37-490d-9136-a94be15be2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ffcbbdeb63462fb875353683b9b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:18Z,use_quota=True,user_id='58353c101b894c40b3bcac7a4e1aa4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f Sep 28 17:19:17 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec11347f-84a6-4b25-9bb0-3eb0b52db55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec11347f-84a6-4b25-9bb0-3eb0b52db55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af85073-f982-46f9-a693-92d5cfadeee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af85073-f982-46f9-a693-92d5cfadeee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a4e955-fe37-490d-9136-a94be15be2b6', 'volume_name': 'volume-21a4e955-fe37-490d-9136-a94be15be2b6', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d5f4be-6edc-4de3-80b0-5635411a7cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d5f4be-6edc-4de3-80b0-5635411a7cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7824b2ba-e16f-4b0c-ae7e-c46e1a3eafac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume 21a4e955-fe37-490d-9136-a94be15be2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a4e955-fe37-490d-9136-a94be15be2b6', 'volume_size': 1} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:18 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.260s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1264163933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e84c08-b1b9-457e-909c-98049705774f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ffcbbdeb63462fb875353683b9b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:17Z,use_quota=True,user_id='58353c101b894c40b3bcac7a4e1aa4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Creating volume 17e84c08-b1b9-457e-909c-98049705774f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:18 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7d36d7-10c2-4c13-835f-7d1ccb79f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f 1073741824 Sep 28 17:19:18 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c836cc29-32db-47e5-9e79-e2cdd888e8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Volume volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f (bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f): created successfully Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c836cc29-32db-47e5-9e79-e2cdd888e8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (6395cad8-0423-450a-937a-bb6e805bae9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:18 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2bb33fbf-8866-447a-898a-c8056609ce4c tempest-AttachVolumeNegativeTest-14368491 None] Created volume successfully. Sep 28 17:19:19 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f 1073741824" returned: 0 in 0.975s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f Sep 28 17:19:19 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f" returned: 0 in 0.569s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-580123540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a4e955-fe37-490d-9136-a94be15be2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ffcbbdeb63462fb875353683b9b8bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:18Z,use_quota=True,user_id='58353c101b894c40b3bcac7a4e1aa4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Creating volume 21a4e955-fe37-490d-9136-a94be15be2b6 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:19 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 1073741824 Sep 28 17:19:20 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0850b5-c073-4e36-b6a8-a57116a26042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e84c08-b1b9-457e-909c-98049705774f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c9fe1b-0638-4b36-9b1e-fd0054ace264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:20 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume volume-17e84c08-b1b9-457e-909c-98049705774f (17e84c08-b1b9-457e-909c-98049705774f): created successfully Sep 28 17:19:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c9fe1b-0638-4b36-9b1e-fd0054ace264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Flow 'volume_create_manager' (3899a635-8383-404c-b29a-706b057c20d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-79cf736c-5e65-4c66-b0e2-78eb4e0e2afc tempest-TestServerVolumeAttachmentScenario-1245957384 None] Created volume successfully. Sep 28 17:19:20 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 1073741824" returned: 0 in 0.984s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 Sep 28 17:19:21 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-26927f6e-bee6-4063-aa11-1f345f0ff2e0 req-00357426-e153-4920-93c1-39321a60bfbd tempest-TestInstancesWithCinderVolumes-366036918 None] Terminate volume connection completed successfully. Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-26927f6e-bee6-4063-aa11-1f345f0ff2e0 req-00357426-e153-4920-93c1-39321a60bfbd tempest-TestInstancesWithCinderVolumes-366036918 None] Deleting attachment a0cf580b-a3bf-41a3-8edb-05d210114e40. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-90ad09f0-cb86-4477-932a-9b0793ba9d24 req-f2bea6e4-a340-4693-b7af-221064b2382c tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-90ad09f0-cb86-4477-932a-9b0793ba9d24 req-f2bea6e4-a340-4693-b7af-221064b2382c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.321s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7824b2ba-e16f-4b0c-ae7e-c46e1a3eafac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a4e955-fe37-490d-9136-a94be15be2b6', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95317369-38ac-4731-a0b2-213bdb473f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-90ad09f0-cb86-4477-932a-9b0793ba9d24 req-f2bea6e4-a340-4693-b7af-221064b2382c tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Volume volume-21a4e955-fe37-490d-9136-a94be15be2b6 (21a4e955-fe37-490d-9136-a94be15be2b6): created successfully Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95317369-38ac-4731-a0b2-213bdb473f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Flow 'volume_create_manager' (3055acf1-0a43-4d3e-bf0f-ba09ed27bab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-33756461-6a23-4b4e-946a-f2b2e458431b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Created volume successfully. Sep 28 17:19:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-90ad09f0-cb86-4477-932a-9b0793ba9d24 req-f2bea6e4-a340-4693-b7af-221064b2382c tempest-AttachVolumeNegativeTest-14368491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91d46fd6-18a4-4e47-b380-03a87a061193', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-90ad09f0-cb86-4477-932a-9b0793ba9d24 req-f2bea6e4-a340-4693-b7af-221064b2382c tempest-AttachVolumeNegativeTest-14368491 None] attachment_update completed successfully. Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-0443040d-cfbe-4fff-8586-fc42529ca160-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-0443040d-cfbe-4fff-8586-fc42529ca160-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-quobyte-0443040d-cfbe-4fff-8586-fc42529ca160" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-0443040d-cfbe-4fff-8586-fc42529ca160" acquired by "delete_volume" :: waited 0.073s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[537626eb-4246-4f62-9135-b52a7fe10f81]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 Sep 28 17:19:23 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:23 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160" returned: 0 in 0.709s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:23 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160 Sep 28 17:19:23 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:24 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0443040d-cfbe-4fff-8586-fc42529ca160" returned: 0 in 0.542s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-0443040d-cfbe-4fff-8586-fc42529ca160" released by "delete_volume" :: held 1.366s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:24 devstack cinder-volume[86929]: WARNING cinder.quota [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1706185148-1471996987 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1706185148-1471996987, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:24 devstack cinder-volume[86929]: WARNING cinder.quota [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1706185148-1471996987 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1706185148-1471996987, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Created reservations ['9dabeb64-d97e-4f82-9284-0eeae6298900', '254da722-2c36-4141-bb99-961893d9ab5f', '42e57e17-847d-4cef-9e50-d01cccfac736', '11bc2f3c-76d1-48d7-bf8e-914a12c4f558'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:24 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:24 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:25 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.568s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Deleted volume successfully. Sep 28 17:19:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ad46e18-77ff-496b-a2cd-70fe851ec02f tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-0443040d-cfbe-4fff-8586-fc42529ca160-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-e7ad46f0-cf30-463f-bcf6-db0ddb36ae67 req-38101235-f6dd-42cc-ac11-f35c3f445468 tempest-AttachVolumeNegativeTest-14368491 None] Terminate volume connection completed successfully. Sep 28 17:19:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-e7ad46f0-cf30-463f-bcf6-db0ddb36ae67 req-38101235-f6dd-42cc-ac11-f35c3f445468 tempest-AttachVolumeNegativeTest-14368491 None] Deleting attachment 91d46fd6-18a4-4e47-b380-03a87a061193. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (9f6ac792-45b6-4aaf-8347-8d9eabfaf979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95bc1a1-6828-40f1-8868-2e6680119fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95bc1a1-6828-40f1-8868-2e6680119fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051357609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5222ced7-d78c-4b51-99c7-fd53e75add66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:33Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e02d5c-5ab7-408c-9363-8d1ffb41c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e02d5c-5ab7-408c-9363-8d1ffb41c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d736e8ff-3eaa-4f39-be54-4a9f3a209d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d736e8ff-3eaa-4f39-be54-4a9f3a209d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5222ced7-d78c-4b51-99c7-fd53e75add66', 'volume_name': 'volume-5222ced7-d78c-4b51-99c7-fd53e75add66', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d31622-7061-43ce-aaa6-71229a2b7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d31622-7061-43ce-aaa6-71229a2b7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfaa8f-0657-4f0b-9f80-eb76ac0b4449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Volume 5222ced7-d78c-4b51-99c7-fd53e75add66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5222ced7-d78c-4b51-99c7-fd53e75add66', 'volume_size': 1} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051357609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5222ced7-d78c-4b51-99c7-fd53e75add66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:33Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Creating volume 5222ced7-d78c-4b51-99c7-fd53e75add66 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:33 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:33 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 1073741824 Sep 28 17:19:33 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-bb35fa9f-af7b-43bf-93ba-628eb70b5213 req-ac2e0a9e-e314-44a2-9c39-c595335c7df2 tempest-TestInstancesWithCinderVolumes-366036918 None] Terminate volume connection completed successfully. Sep 28 17:19:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-bb35fa9f-af7b-43bf-93ba-628eb70b5213 req-ac2e0a9e-e314-44a2-9c39-c595335c7df2 tempest-TestInstancesWithCinderVolumes-366036918 None] Deleting attachment bea9f3d7-1a60-4b58-851a-8087b58881ff. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:35 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 1073741824" returned: 0 in 1.453s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 Sep 28 17:19:35 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66" returned: 0 in 1.237s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] <== create_volume: return (2973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.985s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfaa8f-0657-4f0b-9f80-eb76ac0b4449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5222ced7-d78c-4b51-99c7-fd53e75add66', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c7d8b3-8310-4e5e-8864-f5ea820e9a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Volume volume-5222ced7-d78c-4b51-99c7-fd53e75add66 (5222ced7-d78c-4b51-99c7-fd53e75add66): created successfully Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c7d8b3-8310-4e5e-8864-f5ea820e9a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (9f6ac792-45b6-4aaf-8347-8d9eabfaf979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-28beb9e8-8135-44bc-9cb2-44528c843edf tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:19:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-ee150beb-ef67-47ce-85d4-aecc9773ddb4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-ee150beb-ef67-47ce-85d4-aecc9773ddb4-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "cinder-quobyte-ee150beb-ef67-47ce-85d4-aecc9773ddb4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-ee150beb-ef67-47ce-85d4-aecc9773ddb4" acquired by "delete_volume" :: waited 0.053s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8de61a-636b-4d59-9d94-ea03c6ba11b0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-371da32b-5084-4226-be56-7fea77e8d28a tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66" by "attach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-371da32b-5084-4226-be56-7fea77e8d28a tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66" acquired by "attach_volume" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 Sep 28 17:19:38 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-371da32b-5084-4226-be56-7fea77e8d28a tempest-VolumesActionsTest-493180928 None] Attaching volume 5222ced7-d78c-4b51-99c7-fd53e75add66 to instance 09e77b06-b8c1-4535-9e20-e7feebcff57e at mountpoint /dev/vdb on host None. Sep 28 17:19:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-371da32b-5084-4226-be56-7fea77e8d28a tempest-VolumesActionsTest-493180928 None] Attach volume completed successfully. Sep 28 17:19:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-371da32b-5084-4226-be56-7fea77e8d28a tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66" released by "attach_volume" :: held 0.330s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:39 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4" returned: 0 in 1.159s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4 Sep 28 17:19:39 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ee150beb-ef67-47ce-85d4-aecc9773ddb4" returned: 0 in 0.735s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-quobyte-ee150beb-ef67-47ce-85d4-aecc9773ddb4" released by "delete_volume" :: held 2.052s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[86929]: WARNING cinder.quota [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061890709-737695450 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061890709-737695450, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:40 devstack cinder-volume[86929]: WARNING cinder.quota [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061890709-737695450 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1061890709-737695450, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Created reservations ['e83735e2-ffc3-4b6b-83b0-5f30336557aa', 'cbab1b6b-804c-46ac-bc45-b0aff7f0686e', '01153cc6-17bf-4b22-9de1-35552afd4150', '9c2197d4-f7b2-4935-8758-710e2e9e2549'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Terminate volume connection completed successfully. Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" by "detach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:40 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:40 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Detaching volume 5222ced7-d78c-4b51-99c7-fd53e75add66 from instance 09e77b06-b8c1-4535-9e20-e7feebcff57e. Sep 28 17:19:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Detach volume completed successfully. Sep 28 17:19:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e48835cd-b3ed-4e89-8de6-dd3473bf6b7b tempest-VolumesActionsTest-1752558361 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" released by "detach_volume" :: held 0.246s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba024f41-d53b-4c9e-8d8c-615e3db1cfbd tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" by "detach_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba024f41-d53b-4c9e-8d8c-615e3db1cfbd tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" acquired by "detach_volume" :: waited 0.074s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ba024f41-d53b-4c9e-8d8c-615e3db1cfbd tempest-VolumesActionsTest-493180928 None] Volume detach called, but volume not attached. Sep 28 17:19:41 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba024f41-d53b-4c9e-8d8c-615e3db1cfbd tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 1.213s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Deleted volume successfully. Sep 28 17:19:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6791a60b-4022-4253-b954-7666b1e46cde tempest-TestInstancesWithCinderVolumes-366036918 None] Lock "cinder-ee150beb-ef67-47ce-85d4-aecc9773ddb4-delete_volume" released by "delete_volume" :: held 4.084s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-quobyte-5222ced7-d78c-4b51-99c7-fd53e75add66" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "cinder-quobyte-5222ced7-d78c-4b51-99c7-fd53e75add66" acquired by "delete_volume" :: waited 0.050s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c9f6c-e06c-448a-aeee-b69682ab289c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:43 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 Sep 28 17:19:43 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66" returned: 0 in 0.800s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:43 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66 Sep 28 17:19:43 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:44 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5222ced7-d78c-4b51-99c7-fd53e75add66" returned: 0 in 0.581s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "cinder-quobyte-5222ced7-d78c-4b51-99c7-fd53e75add66" released by "delete_volume" :: held 1.508s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Created reservations ['80ccb5a0-175d-476a-a5dd-cfd817875033', 'b7e53cfa-cb9c-4a92-8481-6ec43d896d86', '7ed3cb4d-acea-4e66-92fa-4ce8b1ba81ac', 'adb98db4-c511-42b2-bba3-fa69aedd8dcc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:44 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:44 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:45 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.457s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:45 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Deleted volume successfully. Sep 28 17:19:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-76aface9-b8a1-4dd7-91ce-123d9d50bc8e tempest-VolumesActionsTest-493180928 None] Lock "cinder-5222ced7-d78c-4b51-99c7-fd53e75add66-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (bf4689d1-139f-472d-9451-df1edb5d7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66611907-2f6f-4627-af75-8de9c0c9c374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66611907-2f6f-4627-af75-8de9c0c9c374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-229108286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae93192-9bd6-4f99-8398-7534d1f84584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:50Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1779678a-e344-488b-807a-5e8c3664d8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1779678a-e344-488b-807a-5e8c3664d8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d7a3a1-24a9-4259-a81f-38deef80fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d7a3a1-24a9-4259-a81f-38deef80fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae93192-9bd6-4f99-8398-7534d1f84584', 'volume_name': 'volume-1ae93192-9bd6-4f99-8398-7534d1f84584', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ef91ff-a1df-4fc9-9354-fcec123445e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ef91ff-a1df-4fc9-9354-fcec123445e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac3d48-1ccb-438f-989f-23c4a977c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:50 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Volume 1ae93192-9bd6-4f99-8398-7534d1f84584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae93192-9bd6-4f99-8398-7534d1f84584', 'volume_size': 1} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-229108286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae93192-9bd6-4f99-8398-7534d1f84584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:50Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Creating volume 1ae93192-9bd6-4f99-8398-7534d1f84584 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:50 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:50 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 1073741824 Sep 28 17:19:50 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:51 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 1073741824" returned: 0 in 0.911s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:51 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 Sep 28 17:19:51 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:52 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584" returned: 0 in 0.539s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac3d48-1ccb-438f-989f-23c4a977c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae93192-9bd6-4f99-8398-7534d1f84584', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1f209d-6b5c-485c-a5b9-f4ef258eacc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Volume volume-1ae93192-9bd6-4f99-8398-7534d1f84584 (1ae93192-9bd6-4f99-8398-7534d1f84584): created successfully Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1f209d-6b5c-485c-a5b9-f4ef258eacc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (bf4689d1-139f-472d-9451-df1edb5d7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bae3f720-030d-42df-b7a7-c2747139c5db tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-1ae93192-9bd6-4f99-8398-7534d1f84584-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "cinder-1ae93192-9bd6-4f99-8398-7534d1f84584-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-quobyte-1ae93192-9bd6-4f99-8398-7534d1f84584" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-1ae93192-9bd6-4f99-8398-7534d1f84584" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96bd9b8-c2b7-4c42-8c19-2adec8951cf2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:53 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 Sep 28 17:19:53 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:54 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584" returned: 0 in 0.875s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:54 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584 Sep 28 17:19:54 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:54 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1ae93192-9bd6-4f99-8398-7534d1f84584" returned: 0 in 0.512s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-1ae93192-9bd6-4f99-8398-7534d1f84584" released by "delete_volume" :: held 1.500s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=61,cinder:SELECT=70,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=57,cinder:UPDATE=51,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:54 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Created reservations ['2f93b3d7-8538-4ae9-a656-0d0f97ab37de', 'c4a5f8b9-fbb2-48e5-9342-d3f8def94795', 'cfc7ea55-983c-4772-8d80-70bff0c90c1d', '385d5214-5796-4fac-aa3c-196d52dd87dc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:55 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:19:55 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:55 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.360s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Deleted volume successfully. Sep 28 17:19:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c4946bec-5e19-4ad9-8905-76ed6ace19da tempest-VolumesActionsTest-1752558361 None] Lock "cinder-1ae93192-9bd6-4f99-8398-7534d1f84584-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (032b7bb4-a1f0-4f90-be12-06b743d5a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983264ee-a5b7-424d-ab1e-838dac73ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983264ee-a5b7-424d-ab1e-838dac73ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1356755714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb15e458-5573-4be0-93f5-e41796298ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:56Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e8b6c1-5f0e-4550-9222-844f0d51efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e8b6c1-5f0e-4550-9222-844f0d51efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a175aca-5680-4af7-9358-2b7c6d99df39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a175aca-5680-4af7-9358-2b7c6d99df39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb15e458-5573-4be0-93f5-e41796298ac1', 'volume_name': 'volume-cb15e458-5573-4be0-93f5-e41796298ac1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b18725-fdb6-4dda-99a0-8cb48f2d2b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b18725-fdb6-4dda-99a0-8cb48f2d2b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a300b4-2364-40dc-9389-641b9dc29aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Volume cb15e458-5573-4be0-93f5-e41796298ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb15e458-5573-4be0-93f5-e41796298ac1', 'volume_size': 1} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1356755714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb15e458-5573-4be0-93f5-e41796298ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:56Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Creating volume cb15e458-5573-4be0-93f5-e41796298ac1 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:56 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:19:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:56 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 1073741824 Sep 28 17:19:56 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:57 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 1073741824" returned: 0 in 0.965s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:57 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 Sep 28 17:19:57 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:58 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1" returned: 0 in 0.543s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a300b4-2364-40dc-9389-641b9dc29aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb15e458-5573-4be0-93f5-e41796298ac1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ef279-2c7d-4fbb-b917-d0df5832623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:58 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Volume volume-cb15e458-5573-4be0-93f5-e41796298ac1 (cb15e458-5573-4be0-93f5-e41796298ac1): created successfully Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ef279-2c7d-4fbb-b917-d0df5832623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (032b7bb4-a1f0-4f90-be12-06b743d5a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6e096c8e-fed8-4ff7-b294-c8ef1b1a931f tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-cb15e458-5573-4be0-93f5-e41796298ac1-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "cinder-cb15e458-5573-4be0-93f5-e41796298ac1-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-quobyte-cb15e458-5573-4be0-93f5-e41796298ac1" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-cb15e458-5573-4be0-93f5-e41796298ac1" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d392015-8c92-45ca-a5d4-cd27096d86b9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 Sep 28 17:19:59 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:59 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1" returned: 0 in 0.623s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:59 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1 Sep 28 17:19:59 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:00 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cb15e458-5573-4be0-93f5-e41796298ac1" returned: 0 in 0.774s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-cb15e458-5573-4be0-93f5-e41796298ac1" released by "delete_volume" :: held 1.503s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Created reservations ['edd8807d-4d34-402e-8eb6-7c9cacfddabf', '8fd924ad-d527-47a6-8739-5df3140d7725', '2b67430a-18bd-4abb-861f-19e5a5255f79', '8ea657af-bee4-4da8-acc4-489703603099'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:00 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:00 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:01 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.526s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:01 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Deleted volume successfully. Sep 28 17:20:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e18c9c1f-5777-42a7-be9d-905c1d44685e tempest-VolumesActionsTest-1752558361 None] Lock "cinder-cb15e458-5573-4be0-93f5-e41796298ac1-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (8149ba7f-4aa9-445e-8bbf-d533b3edc4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2847196-2f8a-4943-bac0-ec993f8900b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2847196-2f8a-4943-bac0-ec993f8900b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1495306233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213d160a-0275-4c00-911e-71289352de32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e59e38-ce63-48c6-83b0-4e522d1279b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e59e38-ce63-48c6-83b0-4e522d1279b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53219ead-7bd8-44a1-b068-66c9c41674a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53219ead-7bd8-44a1-b068-66c9c41674a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213d160a-0275-4c00-911e-71289352de32', 'volume_name': 'volume-213d160a-0275-4c00-911e-71289352de32', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa263a6f-3daf-4d75-bcea-d0238355c334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa263a6f-3daf-4d75-bcea-d0238355c334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbb9d1e-1904-43e5-b443-611553b2623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:03 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Volume 213d160a-0275-4c00-911e-71289352de32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213d160a-0275-4c00-911e-71289352de32', 'volume_size': 1} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1495306233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213d160a-0275-4c00-911e-71289352de32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:03Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Creating volume 213d160a-0275-4c00-911e-71289352de32 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:03 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:03 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 1073741824 Sep 28 17:20:03 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:04 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 1073741824" returned: 0 in 1.051s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:04 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 Sep 28 17:20:04 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:05 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32" returned: 0 in 0.579s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbb9d1e-1904-43e5-b443-611553b2623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213d160a-0275-4c00-911e-71289352de32', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1943bd31-374e-42fc-b0e0-4590afae8ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Volume volume-213d160a-0275-4c00-911e-71289352de32 (213d160a-0275-4c00-911e-71289352de32): created successfully Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1943bd31-374e-42fc-b0e0-4590afae8ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (8149ba7f-4aa9-445e-8bbf-d533b3edc4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dbe36dc2-fbbf-4fec-aa16-9ff088cbc0f9 tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:20:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-213d160a-0275-4c00-911e-71289352de32-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-213d160a-0275-4c00-911e-71289352de32-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-quobyte-213d160a-0275-4c00-911e-71289352de32" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-213d160a-0275-4c00-911e-71289352de32" acquired by "delete_volume" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914e845-9cb8-4284-9987-8c566cd6abee]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 Sep 28 17:20:07 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:07 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:07 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:07 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32" returned: 0 in 0.756s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:08 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32 Sep 28 17:20:08 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:08 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.666s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7df7b781-433b-4083-99fd-09c75a8281cf req-b499aa41-8186-43f7-97eb-a8fe77605e5b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7df7b781-433b-4083-99fd-09c75a8281cf req-b499aa41-8186-43f7-97eb-a8fe77605e5b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-7df7b781-433b-4083-99fd-09c75a8281cf req-b499aa41-8186-43f7-97eb-a8fe77605e5b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-7df7b781-433b-4083-99fd-09c75a8281cf req-b499aa41-8186-43f7-97eb-a8fe77605e5b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-17e84c08-b1b9-457e-909c-98049705774f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c19bae5-3a3d-4806-bffe-22a6fa18851c', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:08 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-213d160a-0275-4c00-911e-71289352de32" returned: 0 in 0.669s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-213d160a-0275-4c00-911e-71289352de32" released by "delete_volume" :: held 1.571s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-7df7b781-433b-4083-99fd-09c75a8281cf req-b499aa41-8186-43f7-97eb-a8fe77605e5b tempest-TestServerVolumeAttachmentScenario-1245957384 None] attachment_update completed successfully. Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Created reservations ['a28cd5fe-95ae-43c0-9d0b-0544a1701759', '4f84c1bd-a33c-44d5-a524-b7d572a2e50a', 'fec6f701-723e-471e-ab9f-48bf4674c8d1', '698a3c45-ecc9-4ba2-8c0a-e61fd91be9f8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:09 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:09 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:09 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.611s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:09 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Deleted volume successfully. Sep 28 17:20:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27dc93d2-2bc4-4aa3-ae00-d84521910345 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-213d160a-0275-4c00-911e-71289352de32-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (fa6820c8-778c-43ea-93de-f849b6f48e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0dab90-e9a2-4730-a683-cb3a0a9489dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0dab90-e9a2-4730-a683-cb3a0a9489dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1546093163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342314bc-7b3c-4ae3-bba7-7be1a96bb65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:11Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea47c95-75b8-4a34-bbdd-de8173d082b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea47c95-75b8-4a34-bbdd-de8173d082b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97815b4c-5907-48f2-82c1-62ed5668ee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97815b4c-5907-48f2-82c1-62ed5668ee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342314bc-7b3c-4ae3-bba7-7be1a96bb65a', 'volume_name': 'volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf617870-8a46-485c-9673-6f1139bff35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf617870-8a46-485c-9673-6f1139bff35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882103b-fe9a-433d-895b-d6e014e2fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Volume 342314bc-7b3c-4ae3-bba7-7be1a96bb65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a', 'volume_size': 1} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1546093163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342314bc-7b3c-4ae3-bba7-7be1a96bb65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:11Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Creating volume 342314bc-7b3c-4ae3-bba7-7be1a96bb65a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:10 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a 1073741824 Sep 28 17:20:11 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:11 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a 1073741824" returned: 0 in 0.827s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:11 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a Sep 28 17:20:11 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:12 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" returned: 0 in 0.428s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4882103b-fe9a-433d-895b-d6e014e2fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56ff458-d2cf-4224-bf75-c8f910518c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:12 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Volume volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a (342314bc-7b3c-4ae3-bba7-7be1a96bb65a): created successfully Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56ff458-d2cf-4224-bf75-c8f910518c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:12 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (fa6820c8-778c-43ea-93de-f849b6f48e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-25b3acf9-e8f8-4e5f-b6b8-ecb5303e0283 tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-342314bc-7b3c-4ae3-bba7-7be1a96bb65a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-342314bc-7b3c-4ae3-bba7-7be1a96bb65a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "cinder-quobyte-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62f397-2611-4ed3-be64-ea9b012c3f8b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:13 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a Sep 28 17:20:13 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:14 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:14 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a Sep 28 17:20:14 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:14 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-quobyte-342314bc-7b3c-4ae3-bba7-7be1a96bb65a" released by "delete_volume" :: held 1.142s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:14 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Created reservations ['4d9f38d2-05f9-4220-b041-25be608e8acf', 'a17a4ef8-ace3-4eaa-a970-65828bfa8ef0', '6a11a9d6-180d-4471-a816-b88c39db7e23', '601b4071-4359-431c-86f8-eb96de2d34bc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:15 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:15 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:15 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:15 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Deleted volume successfully. Sep 28 17:20:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9bb8a80a-a3d4-4d8d-94ab-7d24b0844a32 tempest-VolumesActionsTest-1752558361 None] Lock "cinder-342314bc-7b3c-4ae3-bba7-7be1a96bb65a-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-4356fb99-d1a9-4239-bc75-3337c45ff1e0 req-7c37db69-8b70-4add-a92f-33ed8d117d7b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-4356fb99-d1a9-4239-bc75-3337c45ff1e0 req-7c37db69-8b70-4add-a92f-33ed8d117d7b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-4356fb99-d1a9-4239-bc75-3337c45ff1e0 req-7c37db69-8b70-4add-a92f-33ed8d117d7b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-4356fb99-d1a9-4239-bc75-3337c45ff1e0 req-7c37db69-8b70-4add-a92f-33ed8d117d7b tempest-TestServerVolumeAttachmentScenario-1245957384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-21a4e955-fe37-490d-9136-a94be15be2b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a635ba2-e3db-4359-9ea4-f91a0f800021', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (2a76ea08-c25d-4b56-bb02-ed08236a649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd425234-d24b-4ba3-8669-7643c1edd182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd425234-d24b-4ba3-8669-7643c1edd182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894112653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f3eee7-01ef-440f-a395-1f47da8e3ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e6e7e6-85fc-4999-ad94-7c92801342c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e6e7e6-85fc-4999-ad94-7c92801342c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b685ef5-343c-4c33-8b22-ad76a4348da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b685ef5-343c-4c33-8b22-ad76a4348da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f3eee7-01ef-440f-a395-1f47da8e3ccb', 'volume_name': 'volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfc8a75-f4a2-4084-829b-4a7b47aa6505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfc8a75-f4a2-4084-829b-4a7b47aa6505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdc013c-aabf-49ea-ad8a-ea1ec1af8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Volume d6f3eee7-01ef-440f-a395-1f47da8e3ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb', 'volume_size': 1} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894112653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f3eee7-01ef-440f-a395-1f47da8e3ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af05424bf02c4016866d18ad727fec0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:17Z,use_quota=True,user_id='7ea00bdb73f44490b5fe72939203c330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Creating volume d6f3eee7-01ef-440f-a395-1f47da8e3ccb {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:16 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-4356fb99-d1a9-4239-bc75-3337c45ff1e0 req-7c37db69-8b70-4add-a92f-33ed8d117d7b tempest-TestServerVolumeAttachmentScenario-1245957384 None] attachment_update completed successfully. Sep 28 17:20:16 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb 1073741824 Sep 28 17:20:16 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb 1073741824" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:17 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb Sep 28 17:20:17 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:17 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" returned: 0 in 0.435s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdc013c-aabf-49ea-ad8a-ea1ec1af8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd451d4-f745-4405-993b-694c51c6d111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Volume volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb (d6f3eee7-01ef-440f-a395-1f47da8e3ccb): created successfully Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd451d4-f745-4405-993b-694c51c6d111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Flow 'volume_create_manager' (2a76ea08-c25d-4b56-bb02-ed08236a649e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-957457b3-bb6c-4ae2-a408-6f4ad032cc32 tempest-VolumesActionsTest-493180928 None] Created volume successfully. Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-d6f3eee7-01ef-440f-a395-1f47da8e3ccb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "cinder-d6f3eee7-01ef-440f-a395-1f47da8e3ccb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-951f0712-7d73-4569-add6-49a187551b6a req-479fd0c9-71a5-4689-8485-055ff0cff407 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Terminate volume connection completed successfully. Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-951f0712-7d73-4569-add6-49a187551b6a req-479fd0c9-71a5-4689-8485-055ff0cff407 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Deleting attachment 2a635ba2-e3db-4359-9ea4-f91a0f800021. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Acquiring lock "cinder-quobyte-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "cinder-quobyte-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666214c-d775-4e0c-8c93-641b2782f8db]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb Sep 28 17:20:20 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:20 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" returned: 0 in 0.614s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:20 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb Sep 28 17:20:20 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" returned: 0 in 0.501s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "cinder-quobyte-d6f3eee7-01ef-440f-a395-1f47da8e3ccb" released by "delete_volume" :: held 1.203s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Created reservations ['d298d9fb-e507-45d4-8b19-14c3b0c11813', '3073bba0-dcff-48b7-844b-cf015ae707e6', 'fa1a8285-ac2a-48d4-8ed5-fc1c51c3f94b', '49b952f1-2e75-4c69-acbf-08652a4a15d0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:21 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:21 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-53945f61-e78e-45bd-a29d-7c453d1b853f req-bcc2f251-4967-4f94-afd3-2890ad1772af tempest-TestServerVolumeAttachmentScenario-1245957384 None] Terminate volume connection completed successfully. Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-53945f61-e78e-45bd-a29d-7c453d1b853f req-bcc2f251-4967-4f94-afd3-2890ad1772af tempest-TestServerVolumeAttachmentScenario-1245957384 None] Deleting attachment 3c19bae5-3a3d-4806-bffe-22a6fa18851c. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:21 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.393s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Deleted volume successfully. Sep 28 17:20:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0cac2d9c-ed99-44c9-9de9-1593a3469a42 tempest-VolumesActionsTest-493180928 None] Lock "cinder-d6f3eee7-01ef-440f-a395-1f47da8e3ccb-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (7328b9b9-31a4-4aaa-af13-a77c15a8fb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8b89e2-a473-47e7-a3a2-9d278adf3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8b89e2-a473-47e7-a3a2-9d278adf3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-457489249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb368af1-da47-4720-b197-6fcd66c88c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:28Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c40227-c43c-42ff-a759-24c1b5c4ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c40227-c43c-42ff-a759-24c1b5c4ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bed9f5c-54ee-4866-875e-39c55a702e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bed9f5c-54ee-4866-875e-39c55a702e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb368af1-da47-4720-b197-6fcd66c88c1c', 'volume_name': 'volume-fb368af1-da47-4720-b197-6fcd66c88c1c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f2b0a-0723-40c7-9687-b2fcdb8d7dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f2b0a-0723-40c7-9687-b2fcdb8d7dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12c825-d5c7-4844-879d-46deb100ed65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:27 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Volume fb368af1-da47-4720-b197-6fcd66c88c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb368af1-da47-4720-b197-6fcd66c88c1c', 'volume_size': 1} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-457489249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb368af1-da47-4720-b197-6fcd66c88c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94121afe2a604a1f8c14b1387afc0d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:28Z,use_quota=True,user_id='3c782e57de8a49b1bbd8dcaa38380518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Creating volume fb368af1-da47-4720-b197-6fcd66c88c1c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:27 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:27 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c 1073741824 Sep 28 17:20:27 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:28 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c 1073741824" returned: 0 in 0.722s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:28 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c Sep 28 17:20:28 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:29 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c" returned: 0 in 0.436s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a12c825-d5c7-4844-879d-46deb100ed65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb368af1-da47-4720-b197-6fcd66c88c1c', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7196b97-5843-4464-a06d-23a1eb302dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Volume volume-fb368af1-da47-4720-b197-6fcd66c88c1c (fb368af1-da47-4720-b197-6fcd66c88c1c): created successfully Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7196b97-5843-4464-a06d-23a1eb302dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Flow 'volume_create_manager' (7328b9b9-31a4-4aaa-af13-a77c15a8fb47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-669108c2-0467-49a3-bf17-be4c435f4297 tempest-AttachVolumeNegativeTest-14368491 None] Created volume successfully. Sep 28 17:20:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-c75353f6-2fb1-49bb-a6a9-03185e74b481 req-2d17c509-cde5-464a-88c8-e4f72aca8d98 tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-c75353f6-2fb1-49bb-a6a9-03185e74b481 req-2d17c509-cde5-464a-88c8-e4f72aca8d98 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-c75353f6-2fb1-49bb-a6a9-03185e74b481 req-2d17c509-cde5-464a-88c8-e4f72aca8d98 tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-c75353f6-2fb1-49bb-a6a9-03185e74b481 req-2d17c509-cde5-464a-88c8-e4f72aca8d98 tempest-AttachVolumeNegativeTest-14368491 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-fb368af1-da47-4720-b197-6fcd66c88c1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d112f09-ba32-4a6a-b72b-4ae2362bb17f', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-c75353f6-2fb1-49bb-a6a9-03185e74b481 req-2d17c509-cde5-464a-88c8-e4f72aca8d98 tempest-AttachVolumeNegativeTest-14368491 None] attachment_update completed successfully. Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "cinder-21a4e955-fe37-490d-9136-a94be15be2b6-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-21a4e955-fe37-490d-9136-a94be15be2b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "cinder-quobyte-21a4e955-fe37-490d-9136-a94be15be2b6" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-quobyte-21a4e955-fe37-490d-9136-a94be15be2b6" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56868b9-c8c8-4285-afb8-3d0ab2e248e0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:33 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 Sep 28 17:20:33 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-69ba3dc3-41d6-4d23-aaed-e70d5e2fe986 req-fabc4543-0e91-47c0-9112-b4419c49f349 tempest-AttachVolumeNegativeTest-14368491 None] Terminate volume connection completed successfully. Sep 28 17:20:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-69ba3dc3-41d6-4d23-aaed-e70d5e2fe986 req-fabc4543-0e91-47c0-9112-b4419c49f349 tempest-AttachVolumeNegativeTest-14368491 None] Deleting attachment 3d112f09-ba32-4a6a-b72b-4ae2362bb17f. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:20:34 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6" returned: 0 in 0.770s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:34 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6 Sep 28 17:20:34 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:35 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-21a4e955-fe37-490d-9136-a94be15be2b6" returned: 0 in 0.523s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-quobyte-21a4e955-fe37-490d-9136-a94be15be2b6" released by "delete_volume" :: held 1.376s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Created reservations ['ccec6c2a-d728-4c5f-a274-d008f07e4481', '0c8c5370-4dc9-474e-b737-3ea405044ced', '26e6e792-a289-4105-9d8a-9c7405f42355', '2366a66f-e020-49e7-ad0e-8163438366c5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:35 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:35 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:35 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.535s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Deleted volume successfully. Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-63a097bf-1214-4e23-b352-469b559302a8 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-21a4e955-fe37-490d-9136-a94be15be2b6-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "cinder-17e84c08-b1b9-457e-909c-98049705774f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-17e84c08-b1b9-457e-909c-98049705774f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "cinder-quobyte-17e84c08-b1b9-457e-909c-98049705774f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-quobyte-17e84c08-b1b9-457e-909c-98049705774f" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d858a2ea-4ddd-4a5f-8e0a-80747ef07da0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:36 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f Sep 28 17:20:36 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:36 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:36 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f Sep 28 17:20:36 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:37 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-17e84c08-b1b9-457e-909c-98049705774f" returned: 0 in 0.424s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-quobyte-17e84c08-b1b9-457e-909c-98049705774f" released by "delete_volume" :: held 0.978s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Created reservations ['398a5740-baa1-4d79-9c35-d7d7f0a4ffb5', '6c1e4275-310a-4325-96fa-b2a9f20a8fd8', 'c3514eab-171b-48b9-9a27-fa3705a260cc', '13a2b2f7-a73d-4f7a-8967-8c17a1850d68'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:37 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:37 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:37 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Deleted volume successfully. Sep 28 17:20:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4ecb0b36-4ee1-45d9-a54d-4b6cb413c7d4 tempest-TestServerVolumeAttachmentScenario-1245957384 None] Lock "cinder-17e84c08-b1b9-457e-909c-98049705774f-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-fb368af1-da47-4720-b197-6fcd66c88c1c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-fb368af1-da47-4720-b197-6fcd66c88c1c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-quobyte-fb368af1-da47-4720-b197-6fcd66c88c1c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-fb368af1-da47-4720-b197-6fcd66c88c1c" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef71fac-40b9-491f-acd3-66880ba5de1b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:45 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c Sep 28 17:20:45 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:45 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c" returned: 0 in 0.608s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:45 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c Sep 28 17:20:45 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:46 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-fb368af1-da47-4720-b197-6fcd66c88c1c" returned: 0 in 0.322s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-fb368af1-da47-4720-b197-6fcd66c88c1c" released by "delete_volume" :: held 1.025s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Created reservations ['9e32fde3-1ebc-4097-a7f3-79be34494d3b', '6707e798-2726-4e18-823f-39e9efc08c46', '55739a81-878d-438b-b4e2-941a98d0b2f4', '6d28dd03-0ccb-4c49-9b10-941fd732ee2f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:46 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:46 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:46 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.308s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Deleted volume successfully. Sep 28 17:20:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-239ff030-285a-4ac0-b711-a509c186629a tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-fb368af1-da47-4720-b197-6fcd66c88c1c-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-quobyte-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[174acb3c-8246-4378-a392-3959776d17a0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:47 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f Sep 28 17:20:47 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:48 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" returned: 0 in 0.579s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:48 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f Sep 28 17:20:48 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:48 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" returned: 0 in 0.488s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f" released by "delete_volume" :: held 1.177s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Created reservations ['17a4da75-73d7-4175-b352-563a41ad50a4', '9ff4245b-76b3-4325-9dfa-faedd9774575', 'a9e59725-1aeb-42c0-9695-74968278ca65', 'ec541c84-8300-45af-9435-daedaf5337cd'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:49 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:49 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:49 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.384s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Deleted volume successfully. Sep 28 17:20:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-666a6bd6-fc4d-46c2-974a-29748001f2fd tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-bf721d4e-ba97-4ea7-9d82-d1cbcdd0d21f-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-6d1b7447-eabf-4746-8084-b69ece77e465-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-6d1b7447-eabf-4746-8084-b69ece77e465-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "cinder-quobyte-6d1b7447-eabf-4746-8084-b69ece77e465" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-6d1b7447-eabf-4746-8084-b69ece77e465" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[664dd36c-4637-4b7b-b004-5c849c236866]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:50 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 Sep 28 17:20:50 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465" returned: 0 in 0.812s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:51 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465 Sep 28 17:20:51 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:51 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6d1b7447-eabf-4746-8084-b69ece77e465" returned: 0 in 0.419s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-quobyte-6d1b7447-eabf-4746-8084-b69ece77e465" released by "delete_volume" :: held 1.348s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:51 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Created reservations ['4fa5fce9-bdd8-4a5c-a6d2-d001c45ba147', 'd1f7966e-8f82-4916-a8b5-6e2a7160caea', '82b1c9c6-9974-49e3-8fba-8ab923af5eff', '56e041af-4774-49bd-ba88-0387bfd712ff'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:52 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:20:52 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:52 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.468s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Deleted volume successfully. Sep 28 17:20:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f66d09f6-58b4-44be-88d9-8f05530983af tempest-AttachVolumeNegativeTest-14368491 None] Lock "cinder-6d1b7447-eabf-4746-8084-b69ece77e465-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (0dd6c139-6b27-4ffb-9db3-1b2c9fd63cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97b8b1-45c1-4b34-9d05-7a8214c4af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97b8b1-45c1-4b34-9d05-7a8214c4af3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-453261477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc913ad-89e5-4fba-8e4c-fedd4d5e8981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4140e6b-8805-4d70-be1e-3bd10fc5dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4140e6b-8805-4d70-be1e-3bd10fc5dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e752cdb-9b51-442d-8b10-e040fbf05c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e752cdb-9b51-442d-8b10-e040fbf05c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc913ad-89e5-4fba-8e4c-fedd4d5e8981', 'volume_name': 'volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dab32af-26ef-47e6-9495-63dea8cd57b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dab32af-26ef-47e6-9495-63dea8cd57b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87d5c56-8b62-4a23-813e-1f244699ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Volume 5dc913ad-89e5-4fba-8e4c-fedd4d5e8981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981', 'volume_size': 1} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-453261477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc913ad-89e5-4fba-8e4c-fedd4d5e8981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Creating volume 5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:53 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:53 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 1073741824 Sep 28 17:20:53 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 1073741824" returned: 0 in 0.734s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 Sep 28 17:20:54 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:54 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" returned: 0 in 0.366s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87d5c56-8b62-4a23-813e-1f244699ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e963d49-a687-4e98-93ee-907dc5dd2774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Volume volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 (5dc913ad-89e5-4fba-8e4c-fedd4d5e8981): created successfully Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e963d49-a687-4e98-93ee-907dc5dd2774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (0dd6c139-6b27-4ffb-9db3-1b2c9fd63cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c15e9e3a-87b9-4ba9-af93-1a1852b55ac9 tempest-VolumesListAdminTestJSON-188093599 None] Created volume successfully. Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=81,cinder:INSERT=22,cinder:UPDATE=96,cinder:DELETE=13 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=109,cinder:SELECT=85,cinder:DELETE=3,cinder:INSERT=24 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (72a206fe-105f-4b97-8925-db31267b266e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ba95b8-3642-4fee-9663-dfd553cde553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ba95b8-3642-4fee-9663-dfd553cde553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1016087257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab0c04-5b3c-49cb-af68-d0bf0795f8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:56Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568ebd15-b711-40ad-ba82-176686797b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568ebd15-b711-40ad-ba82-176686797b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f2e100-59b1-4968-a315-5e61b4e6fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f2e100-59b1-4968-a315-5e61b4e6fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ab0c04-5b3c-49cb-af68-d0bf0795f8f3', 'volume_name': 'volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0da3bf-7357-44ff-809c-129c9525b57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0da3bf-7357-44ff-809c-129c9525b57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96cb406-2453-414d-9e62-2f3c4493b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Volume 65ab0c04-5b3c-49cb-af68-d0bf0795f8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3', 'volume_size': 1} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1016087257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ab0c04-5b3c-49cb-af68-d0bf0795f8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:56Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Creating volume 65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:56 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 1073741824 Sep 28 17:20:56 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 1073741824" returned: 0 in 0.645s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:57 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 Sep 28 17:20:57 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" returned: 0 in 0.315s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96cb406-2453-414d-9e62-2f3c4493b01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade03d4d-dae8-4a74-bb13-0c0382d68103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Volume volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 (65ab0c04-5b3c-49cb-af68-d0bf0795f8f3): created successfully Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade03d4d-dae8-4a74-bb13-0c0382d68103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (72a206fe-105f-4b97-8925-db31267b266e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0705b7ad-2be0-418c-822e-981bd5e427e9 tempest-VolumesListAdminTestJSON-188093599 None] Created volume successfully. Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (68f20580-d30f-4aa8-a28c-c9bc70f9c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f4385e-cc2f-460d-9320-3d2d82f45d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f4385e-cc2f-460d-9320-3d2d82f45d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004404100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:59Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a69390-2c23-4d22-89f0-4d2c40d98060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a69390-2c23-4d22-89f0-4d2c40d98060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59082c4-1b39-47fa-bb34-b745c03aa255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59082c4-1b39-47fa-bb34-b745c03aa255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb', 'volume_name': 'volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31fc06a-c1d1-483d-b393-1c6b07457e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31fc06a-c1d1-483d-b393-1c6b07457e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baacb1c1-423a-4251-956d-dabb8f772519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Volume 8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb', 'volume_size': 1} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004404100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0407b13b34864d72abb83cf5bf2acba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:59Z,use_quota=True,user_id='9b6db825413d45f0a5076c2a6da2b89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Creating volume 8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:59 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:20:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:59 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb 1073741824 Sep 28 17:20:59 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:00 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb 1073741824" returned: 0 in 1.030s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:00 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb Sep 28 17:21:00 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:01 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" returned: 0 in 0.438s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baacb1c1-423a-4251-956d-dabb8f772519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a407f9c7-9c0b-4dc3-9416-0c517f9d9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Volume volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb (8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb): created successfully Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a407f9c7-9c0b-4dc3-9416-0c517f9d9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Flow 'volume_create_manager' (68f20580-d30f-4aa8-a28c-c9bc70f9c554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3af730f6-0883-4949-ab79-c1809d062d62 tempest-VolumesListAdminTestJSON-188093599 None] Created volume successfully. Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Flow 'volume_create_manager' (cf0d23bb-3841-4c17-87be-4f3520f91511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80af94f7-c56d-41cb-b97e-76a9a62a0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80af94f7-c56d-41cb-b97e-76a9a62a0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6626a513-e0aa-4f54-8ff0-24fad750b302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbd8e34128489caaef83d9bf823cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:04Z,use_quota=True,user_id='15fced6020ea4f2cad6b210357542caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd9e47d-1563-4fd4-b15b-fc0203d3aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd9e47d-1563-4fd4-b15b-fc0203d3aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b607bd71-89fa-4097-9b30-e5983f3bd67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b607bd71-89fa-4097-9b30-e5983f3bd67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6626a513-e0aa-4f54-8ff0-24fad750b302', 'volume_name': 'volume-6626a513-e0aa-4f54-8ff0-24fad750b302', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500eab28-9b0e-4459-9b6e-b7f0d99a3c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500eab28-9b0e-4459-9b6e-b7f0d99a3c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8717105e-4ead-4bf1-bc96-6e00f325792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:03 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Volume 6626a513-e0aa-4f54-8ff0-24fad750b302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6626a513-e0aa-4f54-8ff0-24fad750b302', 'volume_size': 1} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6626a513-e0aa-4f54-8ff0-24fad750b302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dbd8e34128489caaef83d9bf823cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:04Z,use_quota=True,user_id='15fced6020ea4f2cad6b210357542caf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Creating volume 6626a513-e0aa-4f54-8ff0-24fad750b302 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:03 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:04 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 1073741824 Sep 28 17:21:04 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:04 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 1073741824" returned: 0 in 0.706s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:04 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 Sep 28 17:21:04 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:05 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302" returned: 0 in 0.456s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8717105e-4ead-4bf1-bc96-6e00f325792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6626a513-e0aa-4f54-8ff0-24fad750b302', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e492b6c-0611-4339-8924-1e4d8433ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Volume volume-6626a513-e0aa-4f54-8ff0-24fad750b302 (6626a513-e0aa-4f54-8ff0-24fad750b302): created successfully Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e492b6c-0611-4339-8924-1e4d8433ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Flow 'volume_create_manager' (cf0d23bb-3841-4c17-87be-4f3520f91511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f0d5d869-32a7-44e7-8343-f819c06c5769 tempest-VolumesListAdminTestJSON-331029321 None] Created volume successfully. Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Acquiring lock "cinder-6626a513-e0aa-4f54-8ff0-24fad750b302-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "cinder-6626a513-e0aa-4f54-8ff0-24fad750b302-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Acquiring lock "cinder-quobyte-6626a513-e0aa-4f54-8ff0-24fad750b302" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "cinder-quobyte-6626a513-e0aa-4f54-8ff0-24fad750b302" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4227b2-c245-454f-999c-0539493bc96d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-quobyte-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:06 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 Sep 28 17:21:06 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1905c38-2933-4113-824c-f76b5db4e25f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:06 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb Sep 28 17:21:06 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302" returned: 0 in 0.752s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302 Sep 28 17:21:07 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" returned: 0 in 0.868s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb Sep 28 17:21:07 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:07 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6626a513-e0aa-4f54-8ff0-24fad750b302" returned: 0 in 0.672s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:07 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:07 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "cinder-quobyte-6626a513-e0aa-4f54-8ff0-24fad750b302" released by "delete_volume" :: held 1.574s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:07 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Created reservations ['b32ad9bb-8e92-4a99-bb07-5bce8c8476f6', 'e44f0a5d-0f0b-4908-b901-874a35d910be', '21a1387f-5d59-4ac1-836f-3c0d46d2b195', '743250bf-7ea0-43ec-a763-0d740b141449'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:08 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" returned: 0 in 0.713s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb" released by "delete_volume" :: held 1.702s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:08 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Created reservations ['72af8025-348a-4ad7-8462-6a2a6ce74f0e', 'ebd9e86e-bfd7-431a-a02a-76cb5765fabe', 'c5024405-41dc-427e-b555-91bbb2cca9ed', '505d3222-4853-4f8c-9173-75f60eec1fd4'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:08 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.822s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:08 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:08 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:08 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.489s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Deleted volume successfully. Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d145cfe2-5250-4e57-9edc-1407b189d427 tempest-VolumesListAdminTestJSON-331029321 None] Lock "cinder-6626a513-e0aa-4f54-8ff0-24fad750b302-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-quobyte-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:09 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.621s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Deleted volume successfully. Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[366826ae-959d-46f2-b292-a6fa5357c71c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1c29d832-03d9-4cda-b48a-4f0e64620441 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-8ea2f1f4-ae90-4e8b-9fef-0bed8bdb6fcb-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:09 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 Sep 28 17:21:09 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:09 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" returned: 0 in 0.658s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:09 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3 Sep 28 17:21:09 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:10 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" returned: 0 in 0.516s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3" released by "delete_volume" :: held 1.285s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Created reservations ['4acab393-1e3e-43ef-9db0-8c824aafdd81', '24721550-2941-4c39-8dc8-755ec58d3f03', '8803e708-32f7-4fa6-a243-55ef6aec5975', 'f1169bee-5b48-4f94-913b-dd05a2ece92d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:10 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:10 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:11 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Deleted volume successfully. Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0ba341e7-4a86-43b8-b1cc-f39b3f3bc29d tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-65ab0c04-5b3c-49cb-af68-d0bf0795f8f3-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "cinder-quobyte-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596265f-b269-42ce-a9e4-dfff1ac41d6d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:11 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 Sep 28 17:21:11 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:12 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" returned: 0 in 0.586s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:12 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981 Sep 28 17:21:12 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:12 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" returned: 0 in 0.325s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-quobyte-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981" released by "delete_volume" :: held 0.984s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Created reservations ['191b217d-5481-4205-a3ff-b2a3bcce40c2', '7da66f0c-4e16-430a-8745-8e34e5ef8754', 'fe7d5638-ba04-4d46-a7cc-48f87a01130d', '6a5a61f2-df69-485c-8b83-98f7c3aa128f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:12 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:12 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:13 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.402s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:13 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:13 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Deleted volume successfully. Sep 28 17:21:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbcbf077-f3e5-4e78-b67f-db338da49c40 tempest-VolumesListAdminTestJSON-188093599 None] Lock "cinder-5dc913ad-89e5-4fba-8e4c-fedd4d5e8981-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-264dafa0-d1db-401b-8639-bfb9e947f161 tempest-GroupsV320Test-433772395 None] Group tempest-GroupsV320Test-Group-1154288615: creating Sep 28 17:21:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-264dafa0-d1db-401b-8639-bfb9e947f161 tempest-GroupsV320Test-433772395 None] Group tempest-GroupsV320Test-Group-1154288615: created successfully Sep 28 17:21:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-264dafa0-d1db-401b-8639-bfb9e947f161 tempest-GroupsV320Test-433772395 None] Create group completed successfully. Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Created reservations ['107f6053-b851-4bd7-999d-f084cc716831'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:21 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.315s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4acd7d1e-4695-41fb-b9e5-9c23d7d91d14 tempest-GroupsV320Test-433772395 None] Delete group completed successfully. Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Flow 'volume_create_manager' (394bac5b-e760-4c57-b841-ea2fb515bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57720471-d0ea-434a-a020-afa922a9635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57720471-d0ea-434a-a020-afa922a9635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1890620406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c49f6a-57d5-406e-a490-98791121d6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb043ca0cae24c51b4f92f884f59dd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='6ff4bc995f064088b9f68ae3a099fd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332b2cad-fe70-418e-a28e-e4befaf69b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332b2cad-fe70-418e-a28e-e4befaf69b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced6905-11da-4e45-9e24-955f00df92ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced6905-11da-4e45-9e24-955f00df92ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c49f6a-57d5-406e-a490-98791121d6ec', 'volume_name': 'volume-35c49f6a-57d5-406e-a490-98791121d6ec', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea6d8a0-7428-4d62-82c3-91e3d7bc9f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea6d8a0-7428-4d62-82c3-91e3d7bc9f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406d4281-d3d8-4901-a482-f62b90231a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:23 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Volume 35c49f6a-57d5-406e-a490-98791121d6ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c49f6a-57d5-406e-a490-98791121d6ec', 'volume_size': 1} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1890620406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c49f6a-57d5-406e-a490-98791121d6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb043ca0cae24c51b4f92f884f59dd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:23Z,use_quota=True,user_id='6ff4bc995f064088b9f68ae3a099fd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Creating volume 35c49f6a-57d5-406e-a490-98791121d6ec {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:23 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:23 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec 1073741824 Sep 28 17:21:23 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec 1073741824" returned: 0 in 0.769s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:24 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec Sep 28 17:21:24 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:24 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec" returned: 0 in 0.334s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406d4281-d3d8-4901-a482-f62b90231a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c49f6a-57d5-406e-a490-98791121d6ec', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1056a3c-0051-49ed-809a-3c360e775074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:24 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Volume volume-35c49f6a-57d5-406e-a490-98791121d6ec (35c49f6a-57d5-406e-a490-98791121d6ec): created successfully Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1056a3c-0051-49ed-809a-3c360e775074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Flow 'volume_create_manager' (394bac5b-e760-4c57-b841-ea2fb515bedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-03abf2ca-af21-4efd-87be-6a138424eff3 tempest-AbsoluteLimitsTests-1649265547 None] Created volume successfully. Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Acquiring lock "cinder-35c49f6a-57d5-406e-a490-98791121d6ec-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "cinder-35c49f6a-57d5-406e-a490-98791121d6ec-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Acquiring lock "cinder-quobyte-35c49f6a-57d5-406e-a490-98791121d6ec" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "cinder-quobyte-35c49f6a-57d5-406e-a490-98791121d6ec" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af49d3-3444-44e7-a094-c0f604071f99]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec Sep 28 17:21:26 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec" returned: 0 in 0.504s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:26 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec Sep 28 17:21:26 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:26 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-35c49f6a-57d5-406e-a490-98791121d6ec" returned: 0 in 0.432s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "cinder-quobyte-35c49f6a-57d5-406e-a490-98791121d6ec" released by "delete_volume" :: held 1.026s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:26 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Created reservations ['bb8c9473-9b90-417e-88cb-928be6a189bd', 'bd35aaa1-2013-4eb8-8ecc-6498d7bbd33f', '6b200635-b9a9-4bc1-9469-5bdb5e8ceb79', '73963d33-d0c7-4574-8fd7-3443199fe48c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:27 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:27 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:27 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Deleted volume successfully. Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bae156b9-5fb1-425a-af36-dc1fab366f5f tempest-AbsoluteLimitsTests-1649265547 None] Lock "cinder-35c49f6a-57d5-406e-a490-98791121d6ec-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Flow 'volume_create_manager' (1f9af160-7624-496b-a69a-2edc81a13c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61fe141-eb45-4c14-a637-dd7fe905a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61fe141-eb45-4c14-a637-dd7fe905a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-86390077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cca239e-fe0b-4a36-a680-24bc433e4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40d4d0026c645c0930857aeef36fe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:28Z,use_quota=True,user_id='986e22db239c46c99ee1e46c1084f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c66fbf-98a4-48ed-8710-e2278e217cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c66fbf-98a4-48ed-8710-e2278e217cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46142c6e-a147-4641-b263-762f3add3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46142c6e-a147-4641-b263-762f3add3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cca239e-fe0b-4a36-a680-24bc433e4ef4', 'volume_name': 'volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710db8fa-6b8b-4f5d-8363-0f0c3eeb5949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710db8fa-6b8b-4f5d-8363-0f0c3eeb5949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c995230-e960-48bb-86e1-46b9b75f434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:27 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Volume 1cca239e-fe0b-4a36-a680-24bc433e4ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4', 'volume_size': 1} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-86390077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cca239e-fe0b-4a36-a680-24bc433e4ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a40d4d0026c645c0930857aeef36fe66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:28Z,use_quota=True,user_id='986e22db239c46c99ee1e46c1084f7a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Creating volume 1cca239e-fe0b-4a36-a680-24bc433e4ef4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:27 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:27 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 1073741824 Sep 28 17:21:27 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 1073741824" returned: 0 in 0.744s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:28 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 Sep 28 17:21:28 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:28 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4" returned: 0 in 0.325s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c995230-e960-48bb-86e1-46b9b75f434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba34576-c7ee-43cc-857f-44047fb33253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Volume volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 (1cca239e-fe0b-4a36-a680-24bc433e4ef4): created successfully Sep 28 17:21:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba34576-c7ee-43cc-857f-44047fb33253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Flow 'volume_create_manager' (1f9af160-7624-496b-a69a-2edc81a13c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-486dba40-5991-4102-b781-9f7ae4daef95 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Created volume successfully. Sep 28 17:21:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0d643661-ee74-4bf7-8624-81bd91e4b31d req-7463a93e-331f-4bf9-9d75-625fdb54c7af tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0d643661-ee74-4bf7-8624-81bd91e4b31d req-7463a93e-331f-4bf9-9d75-625fdb54c7af tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-0d643661-ee74-4bf7-8624-81bd91e4b31d req-7463a93e-331f-4bf9-9d75-625fdb54c7af tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-0d643661-ee74-4bf7-8624-81bd91e4b31d req-7463a93e-331f-4bf9-9d75-625fdb54c7af tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a1896eb-ed6e-4b12-a98b-ce9f98ae0ec5', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-0d643661-ee74-4bf7-8624-81bd91e4b31d req-7463a93e-331f-4bf9-9d75-625fdb54c7af tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] attachment_update completed successfully. Sep 28 17:21:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-c062eca6-8d1b-4ec3-8e5d-f984290fbb3d req-a593cad5-39f0-40f8-a06c-cbb9a469dc38 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Terminate volume connection completed successfully. Sep 28 17:21:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-c062eca6-8d1b-4ec3-8e5d-f984290fbb3d req-a593cad5-39f0-40f8-a06c-cbb9a469dc38 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Deleting attachment 4a1896eb-ed6e-4b12-a98b-ce9f98ae0ec5. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "cinder-1cca239e-fe0b-4a36-a680-24bc433e4ef4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "cinder-1cca239e-fe0b-4a36-a680-24bc433e4ef4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "cinder-quobyte-1cca239e-fe0b-4a36-a680-24bc433e4ef4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "cinder-quobyte-1cca239e-fe0b-4a36-a680-24bc433e4ef4" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa54f6-39d2-4490-9062-e8616d941881]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 Sep 28 17:21:37 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:37 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4" returned: 0 in 0.781s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:37 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4 Sep 28 17:21:37 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:37 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1cca239e-fe0b-4a36-a680-24bc433e4ef4" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "cinder-quobyte-1cca239e-fe0b-4a36-a680-24bc433e4ef4" released by "delete_volume" :: held 1.266s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Created reservations ['b9bb3246-3a57-49b5-91cd-8e0de9798337', '81c39a5e-c496-4f10-a556-7ae97fdb8d5a', '89505c58-2e05-43f8-9e0d-075078daedbc', '5840e48d-9a52-4b58-832d-b3fb498db033'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:38 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:38 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:38 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Deleted volume successfully. Sep 28 17:21:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-593b97ac-46e7-4395-8a8a-027a0f6d6ff6 tempest-TestServerVolumeAttachScenarioOldVersion-1086902341 None] Lock "cinder-1cca239e-fe0b-4a36-a680-24bc433e4ef4-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Flow 'volume_create_manager' (d2891d23-b1ec-4bed-9326-bd527290f452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af114d7-2581-45e8-86b2-fe999b6622ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af114d7-2581-45e8-86b2-fe999b6622ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631292978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb914775-227f-4d57-bd52-f445ccd4061a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54b7e377c824ad29c5fcf1508a8f1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:43Z,use_quota=True,user_id='3050fb8245b04e93820c21e10a28ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bb5b4c-b902-4989-af45-c4b811574b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bb5b4c-b902-4989-af45-c4b811574b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8db5a66-f8fd-4884-886f-9f4414c8f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8db5a66-f8fd-4884-886f-9f4414c8f633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb914775-227f-4d57-bd52-f445ccd4061a', 'volume_name': 'volume-eb914775-227f-4d57-bd52-f445ccd4061a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c5a5ad-0f65-49e6-b992-6113e8f2c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c5a5ad-0f65-49e6-b992-6113e8f2c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01eaf3-1ccc-42ce-8407-480ff9f58d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Volume eb914775-227f-4d57-bd52-f445ccd4061a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb914775-227f-4d57-bd52-f445ccd4061a', 'volume_size': 1} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1631292978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb914775-227f-4d57-bd52-f445ccd4061a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54b7e377c824ad29c5fcf1508a8f1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:43Z,use_quota=True,user_id='3050fb8245b04e93820c21e10a28ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Creating volume eb914775-227f-4d57-bd52-f445ccd4061a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:42 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a 1073741824 Sep 28 17:21:42 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a 1073741824" returned: 0 in 0.715s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:43 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a Sep 28 17:21:43 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01eaf3-1ccc-42ce-8407-480ff9f58d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb914775-227f-4d57-bd52-f445ccd4061a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f413ff-1d4e-4b36-92a7-c03f6b063af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Volume volume-eb914775-227f-4d57-bd52-f445ccd4061a (eb914775-227f-4d57-bd52-f445ccd4061a): created successfully Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f413ff-1d4e-4b36-92a7-c03f6b063af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Flow 'volume_create_manager' (d2891d23-b1ec-4bed-9326-bd527290f452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a9600705-e136-440e-9e8e-3c75bf348d89 tempest-VolumesTransfersV355Test-944127040 None] Created volume successfully. Sep 28 17:21:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e11fba68-52f3-4c93-9031-0da371153032 tempest-VolumesTransfersV355Test-633131743 None] Transfer volume completed successfully. Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "cinder-eb914775-227f-4d57-bd52-f445ccd4061a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-eb914775-227f-4d57-bd52-f445ccd4061a-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "cinder-quobyte-eb914775-227f-4d57-bd52-f445ccd4061a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-quobyte-eb914775-227f-4d57-bd52-f445ccd4061a" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[337c0632-882d-4d92-b87e-21b155a99340]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a Sep 28 17:21:47 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a" returned: 0 in 0.603s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:48 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a Sep 28 17:21:48 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-eb914775-227f-4d57-bd52-f445ccd4061a" returned: 0 in 0.386s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-quobyte-eb914775-227f-4d57-bd52-f445ccd4061a" released by "delete_volume" :: held 1.062s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Created reservations ['5891036d-a5eb-4fd1-8041-f11e1c28031f', 'bcd9cdd2-1e0a-45a0-b0dc-84bf5fd364dc', '88bf0136-f81e-45bb-9ca6-0eceb3f5748e', 'f95ce038-215b-4b60-b4dc-cb47b300459f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:49 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:49 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:49 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Flow 'volume_create_manager' (336187dc-bbe6-46c2-af5a-abd3458bea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650c7ba-e7aa-4125-bb1c-8c85f3e4ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.431s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0650c7ba-e7aa-4125-bb1c-8c85f3e4ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080923542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4dbc4b-7ebd-404d-8784-6eca0422b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b365749f154b87974eb3c683e933e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:49Z,use_quota=True,user_id='2d71857ed61b4bd79c40105999605773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14675451-f98f-4928-8950-c5dd16874bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14675451-f98f-4928-8950-c5dd16874bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034c461b-7fba-4067-b251-aaa0c0c80371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:21:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Deleted volume successfully. Sep 28 17:21:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ead820ea-8d75-43ba-8556-9c212c786d89 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-eb914775-227f-4d57-bd52-f445ccd4061a-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034c461b-7fba-4067-b251-aaa0c0c80371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'volume_name': 'volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a99e76-b425-45dd-bad2-7e451cc255a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a99e76-b425-45dd-bad2-7e451cc255a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbd2bd-5772-4497-88d3-2f2e620e83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Trying to clone ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 from image fa438d18-3930-42ab-a121-0871daf80309 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:21:50 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2120cc4-faee-4e6d-8f1a-352d019e941b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Flow 'volume_create_manager' (5cf21a99-6c5a-493b-bd64-905dabc152c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9d94cd-6dcc-4ada-b060-f2563005cdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9d94cd-6dcc-4ada-b060-f2563005cdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-743433283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034d180a-0edc-4642-ae47-8b568e16a2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54b7e377c824ad29c5fcf1508a8f1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:51Z,use_quota=True,user_id='3050fb8245b04e93820c21e10a28ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7b0416-a8b2-48d9-8d7c-682977b85972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7b0416-a8b2-48d9-8d7c-682977b85972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5799877d-19f8-4eac-bcec-00249da1c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5799877d-19f8-4eac-bcec-00249da1c057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034d180a-0edc-4642-ae47-8b568e16a2fc', 'volume_name': 'volume-034d180a-0edc-4642-ae47-8b568e16a2fc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19cd286-7719-49b8-8a14-edb950c4ed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19cd286-7719-49b8-8a14-edb950c4ed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:50 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD Sep 28 17:21:50 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c22651-a3c6-48d0-99fb-b6a7bd7d7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:50 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Volume 034d180a-0edc-4642-ae47-8b568e16a2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034d180a-0edc-4642-ae47-8b568e16a2fc', 'volume_size': 1} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-743433283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034d180a-0edc-4642-ae47-8b568e16a2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54b7e377c824ad29c5fcf1508a8f1b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:51Z,use_quota=True,user_id='3050fb8245b04e93820c21e10a28ff11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Creating volume 034d180a-0edc-4642-ae47-8b568e16a2fc {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:51 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc 1073741824 Sep 28 17:21:51 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:51 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 is fetched for user 2d71857ed61b4bd79c40105999605773. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2dd98a-afc8-49e7-b37c-87c8326f6aa7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD Sep 28 17:21:51 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:51 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc 1073741824" returned: 0 in 0.724s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:51 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc Sep 28 17:21:51 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:51 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:52 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc" returned: 0 in 0.391s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080923542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4dbc4b-7ebd-404d-8784-6eca0422b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b365749f154b87974eb3c683e933e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:49Z,use_quota=True,user_id='2d71857ed61b4bd79c40105999605773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Creating volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:52 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c22651-a3c6-48d0-99fb-b6a7bd7d7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034d180a-0edc-4642-ae47-8b568e16a2fc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be7cea-1179-401d-8728-4d1ceec809e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:52 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1073741824 Sep 28 17:21:52 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Volume volume-034d180a-0edc-4642-ae47-8b568e16a2fc (034d180a-0edc-4642-ae47-8b568e16a2fc): created successfully Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be7cea-1179-401d-8728-4d1ceec809e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Flow 'volume_create_manager' (5cf21a99-6c5a-493b-bd64-905dabc152c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8b2057d1-bc4b-4ef5-92ce-5023af9de111 tempest-VolumesTransfersV355Test-944127040 None] Created volume successfully. Sep 28 17:21:53 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1073741824" returned: 0 in 0.832s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 Sep 28 17:21:53 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "cinder-034d180a-0edc-4642-ae47-8b568e16a2fc-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-034d180a-0edc-4642-ae47-8b568e16a2fc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "cinder-quobyte-034d180a-0edc-4642-ae47-8b568e16a2fc" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-quobyte-034d180a-0edc-4642-ae47-8b568e16a2fc" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[45baecec-0794-4ac7-8e76-86fa2f1de2a6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" returned: 0 in 0.437s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Attempting download of fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:21:53 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc Sep 28 17:21:53 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e72eea4-d08d-45e0-9c24-e80dfbd04321]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:53 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae Sep 28 17:21:53 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:54 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc" returned: 0 in 0.638s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:54 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc Sep 28 17:21:54 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:54 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae" returned: 0 in 0.519s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:54 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae Sep 28 17:21:54 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:54 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-034d180a-0edc-4642-ae47-8b568e16a2fc" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-quobyte-034d180a-0edc-4642-ae47-8b568e16a2fc" released by "delete_volume" :: held 1.136s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:54 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Created reservations ['e522f656-f755-40f5-a879-7d395a61b080', 'cbe83caa-f239-403d-8fbc-f52fc602280b', 'e464e6d4-da91-4bb2-9569-e2cb221e132c', '6b74f39d-b0aa-4a80-95a3-2293c02d993d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:21:55 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae" returned: 1 in 0.796s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_6n2qmeae' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8c1dfb-abce-4a69-9a7f-e18ead36d499]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD Sep 28 17:21:55 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:55 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.530s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Deleted volume successfully. Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7dcbd407-b313-4a82-8e81-df14b7bf2d04 tempest-VolumesTransfersV355Test-1175311043 None] Lock "cinder-034d180a-0edc-4642-ae47-8b568e16a2fc-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:55 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] fa438d18-3930-42ab-a121-0871daf80309 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:21:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:55 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 Sep 28 17:21:55 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:58 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" returned: 0 in 2.899s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:58 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_nk_desubdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:58 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Converted 112.00 MB image at 38.57 MB/s Sep 28 17:21:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:58 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1G Sep 28 17:21:58 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:59 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 1G" returned: 0 in 0.529s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Downloaded image fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 for user 2d71857ed61b4bd79c40105999605773 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Marking volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=62,cinder:UPDATE=101,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Copying metadata from image fa438d18-3930-42ab-a121-0871daf80309 to ba4dbc4b-7ebd-404d-8784-6eca0422b3b0. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Creating volume glance metadata for volume ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 backed by image fa438d18-3930-42ab-a121-0871daf80309 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=82,cinder:UPDATE=85,cinder:INSERT=21,cinder:DELETE=9 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabbd2bd-5772-4497-88d3-2f2e620e83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58dcf3a-c695-46ee-89f0-d43fef5fa2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Volume volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 (ba4dbc4b-7ebd-404d-8784-6eca0422b3b0): created successfully Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58dcf3a-c695-46ee-89f0-d43fef5fa2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Flow 'volume_create_manager' (336187dc-bbe6-46c2-af5a-abd3458bea4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-25208906-bb54-472b-8d9a-62eb755da4b9 tempest-TestShelveInstance-1591534832 None] Created volume successfully. Sep 28 17:22:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f9f91332-770d-4944-9867-e4372c403033 req-0d376b11-89e6-4215-b132-aa2b0ed747c0 tempest-TestShelveInstance-1591534832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f9f91332-770d-4944-9867-e4372c403033 req-0d376b11-89e6-4215-b132-aa2b0ed747c0 tempest-TestShelveInstance-1591534832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f9f91332-770d-4944-9867-e4372c403033 req-0d376b11-89e6-4215-b132-aa2b0ed747c0 tempest-TestShelveInstance-1591534832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-f9f91332-770d-4944-9867-e4372c403033 req-0d376b11-89e6-4215-b132-aa2b0ed747c0 tempest-TestShelveInstance-1591534832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65a86e0b-86ad-4dac-b4cc-20fd59a53a16', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:22:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-f9f91332-770d-4944-9867-e4372c403033 req-0d376b11-89e6-4215-b132-aa2b0ed747c0 tempest-TestShelveInstance-1591534832 None] attachment_update completed successfully. Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:07 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:07 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (e4f6929e-6f84-4baa-8c4a-6f0fbb946e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456ef282-8fe1-4420-bed4-865c3df1c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.590s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456ef282-8fe1-4420-bed4-865c3df1c400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228284345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8034e0f-a656-4d35-b772-32572b192e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:08Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8272fe6e-68c7-4cbd-94b3-d9ebfaf240ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8272fe6e-68c7-4cbd-94b3-d9ebfaf240ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8623fe08-f446-4795-8b6a-573c5e9dfc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8623fe08-f446-4795-8b6a-573c5e9dfc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8034e0f-a656-4d35-b772-32572b192e11', 'volume_name': 'volume-d8034e0f-a656-4d35-b772-32572b192e11', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5e4615-68b1-4d98-82ac-6ae6c48cd381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f5e4615-68b1-4d98-82ac-6ae6c48cd381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127ea0a0-76eb-4fb1-b9d0-de6fd1f964c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:08 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume d8034e0f-a656-4d35-b772-32572b192e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8034e0f-a656-4d35-b772-32572b192e11', 'volume_size': 1} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228284345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8034e0f-a656-4d35-b772-32572b192e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:08Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:08 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:08 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 1073741824 Sep 28 17:22:08 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Flow 'volume_create_manager' (4252bf92-338b-4cd5-ba97-1a1040c0e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440f43a2-555a-464d-a4ca-ee26564a4663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440f43a2-555a-464d-a4ca-ee26564a4663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1143307191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b885e8cf050b4ef2ac405954a0ab1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:09Z,use_quota=True,user_id='1ff8594f74be4de796e2c1db46753aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826808ff-2979-4055-9da8-21a3fdc2e7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826808ff-2979-4055-9da8-21a3fdc2e7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76b263-ce80-4bb6-819c-fe1c017e7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b76b263-ce80-4bb6-819c-fe1c017e7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'volume_name': 'volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e115678-7d41-4f9c-a9ba-d127e2711894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e115678-7d41-4f9c-a9ba-d127e2711894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b514133c-2f26-4cf8-9893-b6cb0a4cc2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Volume cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'volume_size': 1} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 1073741824" returned: 0 in 0.925s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 Sep 28 17:22:09 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11" returned: 0 in 0.589s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1143307191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b885e8cf050b4ef2ac405954a0ab1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:09Z,use_quota=True,user_id='1ff8594f74be4de796e2c1db46753aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Creating volume cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:09 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 1073741824 Sep 28 17:22:10 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127ea0a0-76eb-4fb1-b9d0-de6fd1f964c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8034e0f-a656-4d35-b772-32572b192e11', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ab97de-ff7d-4036-b9eb-a8c6085e2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-d8034e0f-a656-4d35-b772-32572b192e11 (d8034e0f-a656-4d35-b772-32572b192e11): created successfully Sep 28 17:22:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ab97de-ff7d-4036-b9eb-a8c6085e2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (e4f6929e-6f84-4baa-8c4a-6f0fbb946e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ac2fa138-6023-4570-8b84-65fa8470d617 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:10 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 1073741824" returned: 0 in 1.021s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:11 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:11 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:11 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 0.577s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b514133c-2f26-4cf8-9893-b6cb0a4cc2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f837fe-4271-436f-a079-809650ec8dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Volume volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 (cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92): created successfully Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f837fe-4271-436f-a079-809650ec8dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Flow 'volume_create_manager' (4252bf92-338b-4cd5-ba97-1a1040c0e807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:11 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9a270620-37fc-4933-9721-e18f3bf5b209 tempest-VolumesCloneTest-333078082 None] Created volume successfully. Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating offline snapshot 676923d1-0ad9-4527-a664-0b9b70a0c224 of volume d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4492b8e-ea28-4933-82f3-b3939a8bb883]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 Sep 28 17:22:12 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11" returned: 0 in 0.581s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 1G Sep 28 17:22:12 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 1G" returned: 0 in 1.125s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8034e0f-a656-4d35-b772-32572b192e11 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:13 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8034e0f-a656-4d35-b772-32572b192e11 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 Sep 28 17:22:13 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Flow 'volume_create_manager' (6a0c90c8-8fd7-457d-b899-964d5173671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d470d-3ec7-4a31-9616-8a8accdce65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d470d-3ec7-4a31-9616-8a8accdce65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-828323815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13403d6-47cb-415a-af3a-afc5137a9757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b885e8cf050b4ef2ac405954a0ab1dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:14Z,use_quota=True,user_id='1ff8594f74be4de796e2c1db46753aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fdf66f-f9df-4411-bb93-5f6cf7c8cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fdf66f-f9df-4411-bb93-5f6cf7c8cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443b431-8c3e-46a2-889b-9f05ab612227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443b431-8c3e-46a2-889b-9f05ab612227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd13403d6-47cb-415a-af3a-afc5137a9757', 'volume_name': 'volume-d13403d6-47cb-415a-af3a-afc5137a9757', 'volume_size': 2, 'source_volid': 'cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'source_volstatus': 'available'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca167b1-c821-4978-8a54-6ee6f405ac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca167b1-c821-4978-8a54-6ee6f405ac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f258ff8-3041-410e-83e4-4d6e8d997ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Volume d13403d6-47cb-415a-af3a-afc5137a9757: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d13403d6-47cb-415a-af3a-afc5137a9757', 'volume_size': 2, 'source_volid': 'cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'source_volstatus': 'available'} Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:14 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8034e0f-a656-4d35-b772-32572b192e11 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224" returned: 0 in 0.612s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:14 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 is being set with open permissions: ugo+rw Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:14 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 Sep 28 17:22:14 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:14 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224" returned: 0 in 0.619s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:15 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info Sep 28 17:22:15 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:15 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info is being set with open permissions: ugo+rw Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:15 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info Sep 28 17:22:15 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:15 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.info" returned: 0 in 0.481s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.648s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:15 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Cloning volume cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 to volume d13403d6-47cb-415a-af3a-afc5137a9757 Sep 28 17:22:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cf40c1f7-2519-4610-a7a4-3b5394348d4c tempest-CreateVolumesFromSnapshotTest-926211487 None] Create snapshot completed successfully Sep 28 17:22:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Creating offline snapshot 41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 of volume cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:22:16 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312d6e6-29ca-4bff-bed8-170c47152846]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:16 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:16 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 1.050s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:17 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 1G Sep 28 17:22:17 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (4427f943-60a5-4bf5-b80f-9fb68710f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4bffc6-0956-4f51-b2ac-bf9b8b7216dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4bffc6-0956-4f51-b2ac-bf9b8b7216dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479512574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1af4d-192d-4d02-8062-c04ed776fd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:17Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a1fb2f-a6f4-47ac-ad09-5890a0a04ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a1fb2f-a6f4-47ac-ad09-5890a0a04ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d99c3f4-b379-4f13-ad83-25ee3c980f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d99c3f4-b379-4f13-ad83-25ee3c980f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b1af4d-192d-4d02-8062-c04ed776fd08', 'volume_name': 'volume-d7b1af4d-192d-4d02-8062-c04ed776fd08', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f54e1d-885f-4f5f-95e4-6b15f10d0cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f54e1d-885f-4f5f-95e4-6b15f10d0cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed85d869-c0e0-4e92-b2ad-90e1c3173c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume d7b1af4d-192d-4d02-8062-c04ed776fd08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b1af4d-192d-4d02-8062-c04ed776fd08', 'volume_size': 1} Sep 28 17:22:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (e2aad405-1fc8-4293-b10c-f38c5d17a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa60d5f-73b9-481d-8943-d3012b44abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa60d5f-73b9-481d-8943-d3012b44abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994212761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68da7f3b-451d-42fb-b404-70b5997f585a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:18Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addfe925-7212-41f4-8c0e-49a768121cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addfe925-7212-41f4-8c0e-49a768121cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21698f43-e61c-46ad-bd83-ff1ede7ca5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21698f43-e61c-46ad-bd83-ff1ede7ca5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68da7f3b-451d-42fb-b404-70b5997f585a', 'volume_name': 'volume-68da7f3b-451d-42fb-b404-70b5997f585a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:18 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c12c37-8d07-4d0e-976a-ff963d64cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c12c37-8d07-4d0e-976a-ff963d64cf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a863ff6f-6160-4b12-a08e-a4c9932ef2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume 68da7f3b-451d-42fb-b404-70b5997f585a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68da7f3b-451d-42fb-b404-70b5997f585a', 'volume_size': 1} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 1G" returned: 0 in 1.488s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:18 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:19 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (eaebd6b8-1a11-4f9a-9e04-00b3ca620e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb5ca9c-b0b1-4b2a-8fc6-ffe2f58fb9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.937s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:19 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 is being set with open permissions: ugo+rw Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:19 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:19 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb5ca9c-b0b1-4b2a-8fc6-ffe2f58fb9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441624340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a669f09-63ff-41ee-aa90-3a20b08ea4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:19Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09022a10-97f7-405c-b0d0-a101cd5f182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09022a10-97f7-405c-b0d0-a101cd5f182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4984506a-7e5a-4557-8172-8ac1d96f3445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4984506a-7e5a-4557-8172-8ac1d96f3445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a669f09-63ff-41ee-aa90-3a20b08ea4c7', 'volume_name': 'volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05be841-36e3-4cc8-8c1e-abea3f0e7108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05be841-36e3-4cc8-8c1e-abea3f0e7108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bca94d-9f83-4153-873a-539a31e36fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:19 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume 9a669f09-63ff-41ee-aa90-3a20b08ea4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7', 'volume_size': 1} Sep 28 17:22:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:20 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.575s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info Sep 28 17:22:20 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (ba5ff421-b345-4b26-b6c2-0a7e86e0bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08370b4b-8b25-454a-8669-ca28448183c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:20 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08370b4b-8b25-454a-8669-ca28448183c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301215309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28bf0df-1b78-4e9e-a5e1-1967101ad71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:21Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc9cc8-1d65-483a-a592-1611e2ebe00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc9cc8-1d65-483a-a592-1611e2ebe00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106842d0-55c2-4018-aafd-327ad24550ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106842d0-55c2-4018-aafd-327ad24550ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28bf0df-1b78-4e9e-a5e1-1967101ad71a', 'volume_name': 'volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff2e9ef-979e-4b23-874b-2caf33eb888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff2e9ef-979e-4b23-874b-2caf33eb888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4b3da3-c0ae-403b-92ea-3a0b0a51726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume f28bf0df-1b78-4e9e-a5e1-1967101ad71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a', 'volume_size': 1} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info" returned: 0 in 0.932s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info is being set with open permissions: ugo+rw Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info Sep 28 17:22:21 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (45de4f27-6546-4a0c-8db9-df477cce4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17b71b8-e859-4d0c-a9a6-ff86a9018231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17b71b8-e859-4d0c-a9a6-ff86a9018231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125159435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fcfed8-eb14-47d6-953d-e8dc8971244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:22Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8389a7a-3fb8-4a12-83aa-8d9398cbfde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8389a7a-3fb8-4a12-83aa-8d9398cbfde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667061b4-68da-4fb6-8db5-52ca3abb3a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667061b4-68da-4fb6-8db5-52ca3abb3a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fcfed8-eb14-47d6-953d-e8dc8971244b', 'volume_name': 'volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5be226-79cc-4c1b-b681-171c694ed039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5be226-79cc-4c1b-b681-171c694ed039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b33989e-46e2-45b5-b27c-cd24776b7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume a5fcfed8-eb14-47d6-953d-e8dc8971244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b', 'volume_size': 1} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.info" returned: 0 in 0.827s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] snapshot: 41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1, volume: d13403d6-47cb-415a-af3a-afc5137a9757, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861257b-d4c3-4c22-9e0a-7a5f788f91ba]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:22 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:22 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:22 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.624s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0bc4b-92da-4a3a-8fba-6e59765ecc25]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:22 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:22 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:23 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 0.521s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:22:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:22:23 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:22:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:23 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 Sep 28 17:22:23 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:31 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=28,cinder:INSERT=8,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:31 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=30,cinder:INSERT=9,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:34 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757" returned: 0 in 11.118s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92, size 1024.00 MB, duration 11.12 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:34 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Converted 1024.00 MB image at 92.09 MB/s Sep 28 17:22:34 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 is being set with open permissions: ugo+rw Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:34 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 Sep 28 17:22:34 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Flow 'volume_create_manager' (963c5098-11d4-4064-815f-00f976705e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c911580e-448a-425a-8eca-0fd9dab1cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c911580e-448a-425a-8eca-0fd9dab1cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1219163258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7749b6-7715-4ad9-b9b2-9fed23ef2892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9eb5690f59d4a1b9d26c067eea03cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:34Z,use_quota=True,user_id='b1d7fe5091424e95b1ef376d2ca8aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dfb85e-0192-407a-bfa0-b5d0933d6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dfb85e-0192-407a-bfa0-b5d0933d6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20265ad3-f1b0-4c18-b590-99109da12477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:22:34 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757" returned: 0 in 0.419s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" released by "_copy_volume_from_snapshot" :: held 12.822s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-quobyte-41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Deleting offline snapshot 41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 of volume cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] snapshot_file for this snap is: volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20265ad3-f1b0-4c18-b590-99109da12477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b7749b6-7715-4ad9-b9b2-9fed23ef2892', 'volume_name': 'volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebaa24f-4aad-4de0-9843-e7b39b203ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebaa24f-4aad-4de0-9843-e7b39b203ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac803ff2-d1a0-4f4b-b581-fbd123b7b931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Trying to clone 1b7749b6-7715-4ad9-b9b2-9fed23ef2892 from image fa438d18-3930-42ab-a121-0871daf80309 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dc0280-74d8-4dea-8b5c-c3dc6572f4c4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:35 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:22:35 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4499ba5-ad66-40d5-9c20-29d333d1ae6d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.561s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6201f1d-7e8e-40f0-8e31-b161a7c70f49]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD Sep 28 17:22:35 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:35 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 is fetched for user b1d7fe5091424e95b1ef376d2ca8aa2c. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cb44e8-5570-47cd-a5b4-810c962eea5c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD Sep 28 17:22:36 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 0.753s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:36 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:36 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.569s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1 Sep 28 17:22:37 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92.41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-41ffa9a0-5529-4fa6-a9a5-21a0d6008ad1" released by "_delete_snapshot" :: held 2.405s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.510s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.565s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479512574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b1af4d-192d-4d02-8062-c04ed776fd08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:17Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume d7b1af4d-192d-4d02-8062-c04ed776fd08 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:37 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f258ff8-3041-410e-83e4-4d6e8d997ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13403d6-47cb-415a-af3a-afc5137a9757', 'volume_size': 2, 'source_volid': 'cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92', 'source_volstatus': 'available'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c444bd-7e8a-45c4-872b-eb6ab5a2fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:37 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 1073741824 Sep 28 17:22:37 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Volume volume-d13403d6-47cb-415a-af3a-afc5137a9757 (d13403d6-47cb-415a-af3a-afc5137a9757): created successfully Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c444bd-7e8a-45c4-872b-eb6ab5a2fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Flow 'volume_create_manager' (6a0c90c8-8fd7-457d-b899-964d5173671a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-20c1dc4a-bf82-4daa-99b8-2d3b2a51f6be tempest-VolumesCloneTest-333078082 None] Created volume successfully. Sep 28 17:22:38 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 1073741824" returned: 0 in 0.699s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 Sep 28 17:22:38 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08" returned: 0 in 0.407s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994212761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68da7f3b-451d-42fb-b404-70b5997f585a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:18Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume 68da7f3b-451d-42fb-b404-70b5997f585a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:38 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:38 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a 1073741824 Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed85d869-c0e0-4e92-b2ad-90e1c3173c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b1af4d-192d-4d02-8062-c04ed776fd08', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:38 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c969b0-6cf8-4869-96cc-81685be92574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:38 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 (d7b1af4d-192d-4d02-8062-c04ed776fd08): created successfully Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c969b0-6cf8-4869-96cc-81685be92574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (4427f943-60a5-4bf5-b80f-9fb68710f702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-299ec3b4-ef57-4921-9455-93d73446bc6c tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-d13403d6-47cb-415a-af3a-afc5137a9757-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "cinder-d13403d6-47cb-415a-af3a-afc5137a9757-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf31db-f8a0-46c0-af70-c021a027bbee]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 Sep 28 17:22:39 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a 1073741824" returned: 0 in 0.579s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a Sep 28 17:22:39 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757 Sep 28 17:22:39 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a" returned: 0 in 0.310s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.769s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441624340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a669f09-63ff-41ee-aa90-3a20b08ea4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:19Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume 9a669f09-63ff-41ee-aa90-3a20b08ea4c7 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:39 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:39 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 1073741824 Sep 28 17:22:39 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a863ff6f-6160-4b12-a08e-a4c9932ef2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68da7f3b-451d-42fb-b404-70b5997f585a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d7f5f3-c1df-47ec-90b9-49a2176d3a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:39 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-68da7f3b-451d-42fb-b404-70b5997f585a (68da7f3b-451d-42fb-b404-70b5997f585a): created successfully Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d7f5f3-c1df-47ec-90b9-49a2176d3a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (e2aad405-1fc8-4293-b10c-f38c5d17a03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c19e8b14-ddcf-4e3d-a2d8-d984fe4296f7 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:39 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d13403d6-47cb-415a-af3a-afc5137a9757" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-d13403d6-47cb-415a-af3a-afc5137a9757" released by "delete_volume" :: held 0.855s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:39 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Created reservations ['ff3f994e-1aa6-43f6-abbd-a6aa6b2c0d64', '792b9570-2c70-41c9-8879-8e987b7b0e8c', 'a30a3c12-e5ca-477a-bc6b-c24654f504e9', '4af46dad-6c74-4ab5-a2bc-bc09e3922005'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:40 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "cinder-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Acquiring lock "cinder-quobyte-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:40 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 1073741824" returned: 0 in 0.701s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.357s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee7715b-c486-40fb-a65d-d429171b654c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Deleted volume successfully. Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5b0eafa3-8eee-45fc-8f6d-18830eceaf65 tempest-VolumesCloneTest-333078082 None] Lock "cinder-d13403d6-47cb-415a-af3a-afc5137a9757-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:40 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 Sep 28 17:22:40 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:40 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.663s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301215309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28bf0df-1b78-4e9e-a5e1-1967101ad71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:21Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume f28bf0df-1b78-4e9e-a5e1-1967101ad71a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:40 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bca94d-9f83-4153-873a-539a31e36fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a 1073741824 Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78503ab6-bc96-46fe-b957-cb9361af7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:40 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 (9a669f09-63ff-41ee-aa90-3a20b08ea4c7): created successfully Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78503ab6-bc96-46fe-b957-cb9361af7143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:40 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (eaebd6b8-1a11-4f9a-9e04-00b3ca620e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 0.560s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d2e6f136-1436-4e1d-8f2e-24822d992b9b tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:40 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92 Sep 28 17:22:40 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" returned: 0 in 0.341s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "cinder-quobyte-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92" released by "delete_volume" :: held 1.004s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Created reservations ['eb110fc9-3f43-4232-99f3-fcad79a8f445', 'cea7f9b8-1ad1-43b9-a8ff-eb4ec1b81199', '80410c4a-fe28-424f-ae14-c6efd027b47c', '0ca563f6-bb95-4875-a43c-719f3a6efee9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:41 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a 1073741824" returned: 0 in 0.639s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:41 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a Sep 28 17:22:41 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:41 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.340s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Deleted volume successfully. Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f4bbf4-d070-4d2d-af1b-2371fb4fa7af tempest-VolumesCloneTest-333078082 None] Lock "cinder-cc52a1d8-cc7b-46bf-a0c2-f74e8d7bbf92-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:41 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.966s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125159435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fcfed8-eb14-47d6-953d-e8dc8971244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a95a20c699e14881a524ba15cbd8d7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:22Z,use_quota=True,user_id='a7a6065ee29e46d08b328a586a3401dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Creating volume a5fcfed8-eb14-47d6-953d-e8dc8971244b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4b3da3-c0ae-403b-92ea-3a0b0a51726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b 1073741824 Sep 28 17:22:42 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38194a7-5cea-4a33-92e8-d899a551c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a (f28bf0df-1b78-4e9e-a5e1-1967101ad71a): created successfully Sep 28 17:22:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38194a7-5cea-4a33-92e8-d899a551c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (ba5ff421-b345-4b26-b6c2-0a7e86e0bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-08d4fd15-f236-4f8f-b261-d2a7d386382d tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:42 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b 1073741824" returned: 0 in 0.695s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b Sep 28 17:22:42 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b" returned: 0 in 0.543s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.642s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1219163258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7749b6-7715-4ad9-b9b2-9fed23ef2892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9eb5690f59d4a1b9d26c067eea03cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:34Z,use_quota=True,user_id='b1d7fe5091424e95b1ef376d2ca8aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Creating volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:43 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b33989e-46e2-45b5-b27c-cd24776b7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ecd30d-55e6-49f4-8d45-e26f91cca2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:43 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1073741824 Sep 28 17:22:43 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Volume volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b (a5fcfed8-eb14-47d6-953d-e8dc8971244b): created successfully Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ecd30d-55e6-49f4-8d45-e26f91cca2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Flow 'volume_create_manager' (45de4f27-6546-4a0c-8db9-df477cce4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-93bea639-97a9-4f98-bba3-019ab7dd79d1 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created volume successfully. Sep 28 17:22:43 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1073741824" returned: 0 in 0.666s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 Sep 28 17:22:44 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-a5fcfed8-eb14-47d6-953d-e8dc8971244b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-a5fcfed8-eb14-47d6-953d-e8dc8971244b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-a5fcfed8-eb14-47d6-953d-e8dc8971244b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-a5fcfed8-eb14-47d6-953d-e8dc8971244b" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:44 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" returned: 0 in 0.545s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb4820e-d524-4cf8-81d2-cd061bbf3a2f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Attempting download of fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:22:44 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b Sep 28 17:22:44 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd3ad8-1718-4092-b9c4-d276c97734fe]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b" returned: 0 in 0.676s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b Sep 28 17:22:45 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j Sep 28 17:22:45 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:45 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a5fcfed8-eb14-47d6-953d-e8dc8971244b" returned: 0 in 0.553s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j" returned: 0 in 0.737s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-a5fcfed8-eb14-47d6-953d-e8dc8971244b" released by "delete_volume" :: held 1.350s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:45 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['cc858883-ce3f-4963-a740-3fc4c5c08b8e', '6e03b147-b284-43ee-9629-7bf9ad76fc49', '9145bc85-0186-4fb8-a98c-790c3fc8df29', '1b283d64-11eb-48e1-8605-9a4bb0b02899'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:46 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j Sep 28 17:22:46 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:46 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:46 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:46 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j" returned: 1 in 0.560s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_izqzru3j' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c46db6-8a29-4d49-9a1d-3c59e6d277df]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:46 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:22:46 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD Sep 28 17:22:46 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-61e9399b-1d4c-48e4-96c8-9f023f4e2a14 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-a5fcfed8-eb14-47d6-953d-e8dc8971244b-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-f28bf0df-1b78-4e9e-a5e1-1967101ad71a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:46 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] fa438d18-3930-42ab-a121-0871daf80309 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-f28bf0df-1b78-4e9e-a5e1-1967101ad71a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:46 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 Sep 28 17:22:46 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f92378-f4f7-45e2-9e7a-ede1a231e4be]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:47 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a Sep 28 17:22:47 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:47 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" returned: 0 in 0.726s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:47 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a Sep 28 17:22:47 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:48 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" returned: 0 in 0.659s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-f28bf0df-1b78-4e9e-a5e1-1967101ad71a" released by "delete_volume" :: held 1.490s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['17cb56e3-0c0b-44d9-a6f2-0bb8a89e1cf7', '0cab02e8-6e28-4916-9464-9a966003e726', '5689c120-6cff-4d0a-bb9b-c285a38dce48', 'ba27ebd3-4530-4c45-b957-a9838d788c5c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:48 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:48 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-9a669f09-63ff-41ee-aa90-3a20b08ea4c7-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-9a669f09-63ff-41ee-aa90-3a20b08ea4c7-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:49 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.542s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb03ce1a-32c7-40ec-b5a1-1bf25ed5da9e tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-f28bf0df-1b78-4e9e-a5e1-1967101ad71a-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd56ae0-a0c5-4848-b5eb-a3887e11b524]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:49 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 Sep 28 17:22:49 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" returned: 0 in 0.598s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:50 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7 Sep 28 17:22:50 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" returned: 0 in 3.522s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_d_g13zmvdevstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:22:50 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Converted 112.00 MB image at 31.78 MB/s Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:50 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1G Sep 28 17:22:50 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" returned: 0 in 0.695s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-9a669f09-63ff-41ee-aa90-3a20b08ea4c7" released by "delete_volume" :: held 1.434s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['738b27fd-8748-4cd9-953f-f38387ebf14a', '96a3e5f7-1370-40ae-b8f9-eccd479bdb9a', '74ea81c6-d877-47c1-bfc8-449fa8929c8f', '6f6fcdef-d102-47b8-bba6-d9cd83ed96b9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:51 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:51 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-4063446e-e228-4ef5-af88-a6789e71a407 req-5d5e169e-4d8b-425e-84f8-13fca2d38390 tempest-TestShelveInstance-1591534832 None] Terminate volume connection completed successfully. Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-4063446e-e228-4ef5-af88-a6789e71a407 req-5d5e169e-4d8b-425e-84f8-13fca2d38390 tempest-TestShelveInstance-1591534832 None] Deleting attachment 65a86e0b-86ad-4dac-b4cc-20fd59a53a16. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:22:51 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 1G" returned: 0 in 0.982s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Downloaded image fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 for user b1d7fe5091424e95b1ef376d2ca8aa2c is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Marking volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Copying metadata from image fa438d18-3930-42ab-a121-0871daf80309 to 1b7749b6-7715-4ad9-b9b2-9fed23ef2892. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Creating volume glance metadata for volume 1b7749b6-7715-4ad9-b9b2-9fed23ef2892 backed by image fa438d18-3930-42ab-a121-0871daf80309 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac803ff2-d1a0-4f4b-b581-fbd123b7b931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a935ce8-6456-4133-8aa4-a64410ad86cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:51 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Volume volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 (1b7749b6-7715-4ad9-b9b2-9fed23ef2892): created successfully Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a935ce8-6456-4133-8aa4-a64410ad86cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Flow 'volume_create_manager' (963c5098-11d4-4064-815f-00f976705e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-be9e510d-6128-42ec-b1a2-49f73a56f840 tempest-VolumesImageMetadata-1592319886 None] Created volume successfully. Sep 28 17:22:51 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5ead766a-33ad-43e9-9e6b-d658ec31c48d tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-9a669f09-63ff-41ee-aa90-3a20b08ea4c7-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-68da7f3b-451d-42fb-b404-70b5997f585a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-68da7f3b-451d-42fb-b404-70b5997f585a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-68da7f3b-451d-42fb-b404-70b5997f585a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-68da7f3b-451d-42fb-b404-70b5997f585a" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:52 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f4347c-7cf1-41a8-b97c-03fbb200b0e5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:52 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a Sep 28 17:22:52 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:52 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a" returned: 0 in 0.756s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:52 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a Sep 28 17:22:52 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:53 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-68da7f3b-451d-42fb-b404-70b5997f585a" returned: 0 in 0.458s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-68da7f3b-451d-42fb-b404-70b5997f585a" released by "delete_volume" :: held 1.310s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Acquiring lock "cinder-1b7749b6-7715-4ad9-b9b2-9fed23ef2892-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "cinder-1b7749b6-7715-4ad9-b9b2-9fed23ef2892-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['9d27f906-1712-4d73-b097-76d1924e3ac6', '7fa2a70f-3862-40a7-a68f-f160f50a1fc0', 'fdf305fa-86aa-4c95-ac13-650497710eee', '216c6616-6aac-4c96-8052-1002445dbe89'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Acquiring lock "cinder-quobyte-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "cinder-quobyte-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" acquired by "delete_volume" :: waited 0.043s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ac7fd-26b1-4b00-a118-808e2bf38d13]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:53 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:53 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:53 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 Sep 28 17:22:53 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.353s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-abb91e6f-1d29-43ca-8245-6995417071d2 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-68da7f3b-451d-42fb-b404-70b5997f585a-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:54 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" returned: 0 in 0.568s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892 Sep 28 17:22:54 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-d7b1af4d-192d-4d02-8062-c04ed776fd08-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-d7b1af4d-192d-4d02-8062-c04ed776fd08-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-d7b1af4d-192d-4d02-8062-c04ed776fd08" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d7b1af4d-192d-4d02-8062-c04ed776fd08" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4547539c-0d11-44bd-bce0-acffb1e66528]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" returned: 0 in 0.367s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "cinder-quobyte-1b7749b6-7715-4ad9-b9b2-9fed23ef2892" released by "delete_volume" :: held 1.015s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:54 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 Sep 28 17:22:54 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Created reservations ['00658a20-f651-4a41-bf67-289252d63630', '895ffed6-fff8-4699-8d98-97fac4d4c951', '25b25689-6e5d-4190-bd38-4a0555ee4a85', '892b1504-a2f4-4125-92bd-b97b915eb1ce'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:54 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:54 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08" returned: 0 in 0.690s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:55 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08 Sep 28 17:22:55 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:55 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Deleted volume successfully. Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a037d37d-a6a5-44aa-a88b-b4388dcc0e5b tempest-VolumesImageMetadata-1592319886 None] Lock "cinder-1b7749b6-7715-4ad9-b9b2-9fed23ef2892-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:55 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d7b1af4d-192d-4d02-8062-c04ed776fd08" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d7b1af4d-192d-4d02-8062-c04ed776fd08" released by "delete_volume" :: held 1.202s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['f0886f7d-cbab-4966-bac0-8a0b1a07aec4', 'bf8a8f5a-06f8-48bd-b4ce-391460c3b42b', '0694e8e4-5302-490b-9278-72aedc00976f', '3212249d-c077-4baa-9498-d03170ecc0a5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:56 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:22:56 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:56 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.498s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aeea62a0-0fdb-4345-90af-9596158b2404 req-6b8670f4-daa5-41a2-a048-cd3ad556e87f tempest-TestShelveInstance-1591534832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aeea62a0-0fdb-4345-90af-9596158b2404 req-6b8670f4-daa5-41a2-a048-cd3ad556e87f tempest-TestShelveInstance-1591534832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-aeea62a0-0fdb-4345-90af-9596158b2404 req-6b8670f4-daa5-41a2-a048-cd3ad556e87f tempest-TestShelveInstance-1591534832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-415d188a-e03c-4859-8362-ea36afda1462 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-d7b1af4d-192d-4d02-8062-c04ed776fd08-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-aeea62a0-0fdb-4345-90af-9596158b2404 req-6b8670f4-daa5-41a2-a048-cd3ad556e87f tempest-TestShelveInstance-1591534832 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23b5a041-a146-457d-be58-f47607dceb2c', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-676923d1-0ad9-4527-a664-0b9b70a0c224-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-676923d1-0ad9-4527-a664-0b9b70a0c224-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-676923d1-0ad9-4527-a664-0b9b70a0c224" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-676923d1-0ad9-4527-a664-0b9b70a0c224" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleting offline snapshot 676923d1-0ad9-4527-a664-0b9b70a0c224 of volume d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] snapshot_file for this snap is: volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-aeea62a0-0fdb-4345-90af-9596158b2404 req-6b8670f4-daa5-41a2-a048-cd3ad556e87f tempest-TestShelveInstance-1591534832 None] attachment_update completed successfully. Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede7ac05-5336-4bad-b82e-bccbf17fa4fe]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:57 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 Sep 28 17:22:57 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:57 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224" returned: 0 in 0.826s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8034e0f-a656-4d35-b772-32572b192e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:57 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef493fb-3fb3-4a00-836a-d0cc300587b9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 Sep 28 17:22:58 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:58 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11" returned: 0 in 0.634s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:58 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 Sep 28 17:22:58 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:59 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224" returned: 0 in 0.522s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:59 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224 Sep 28 17:22:59 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:59 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11.676923d1-0ad9-4527-a664-0b9b70a0c224" returned: 0 in 0.323s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-676923d1-0ad9-4527-a664-0b9b70a0c224" released by "_delete_snapshot" :: held 2.566s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" released by "delete_snapshot" :: held 2.622s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['1601b20b-51ab-40bd-8f03-23167c8e0700', '168aed57-cf9c-4ac1-a258-192d0acacd3a', 'e0e62b19-77b9-4450-84f9-8fb9a2fbd1eb', 'd0883df4-b278-40c0-aa33-f513205512bb'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Delete snapshot completed successfully. Sep 28 17:22:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b287c3b9-6f8b-4407-ac54-404dcb35aca5 tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-676923d1-0ad9-4527-a664-0b9b70a0c224-delete_snapshot" released by "delete_snapshot" :: held 2.906s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-d8034e0f-a656-4d35-b772-32572b192e11-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-d8034e0f-a656-4d35-b772-32572b192e11-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0417f-4f6c-45fa-88bf-ba9ea9037e0c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 Sep 28 17:23:00 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:00 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11" returned: 0 in 0.654s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:00 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11 Sep 28 17:23:00 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d8034e0f-a656-4d35-b772-32572b192e11" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-quobyte-d8034e0f-a656-4d35-b772-32572b192e11" released by "delete_volume" :: held 1.219s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Created reservations ['4fffb7ce-43e3-4bd4-bde6-aa89ba09551c', 'f218c7c8-6d44-468e-a152-78a6996a9ad3', 'b190a075-34ae-4682-9869-b32bdc9f9fe9', '6d494f68-f7c2-4f19-b808-4ad66f73e8c4'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:01 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.386s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:02 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Deleted volume successfully. Sep 28 17:23:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0127679a-231b-4b34-b54d-11900fbac9de tempest-CreateVolumesFromSnapshotTest-926211487 None] Lock "cinder-d8034e0f-a656-4d35-b772-32572b192e11-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (aa47e3ec-317f-4eca-a9fc-1ea13bbfc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f44288c-ba12-4b67-a779-a953fa95521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f44288c-ba12-4b67-a779-a953fa95521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-620392051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f6e845-9cb7-4543-be14-6d2bffc8e6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89522ed4b70d422b9f0a1a47b281fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='663a5e00952b4768961ed471bbc999bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a84f15-142d-40c2-b559-6e67f80a457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a84f15-142d-40c2-b559-6e67f80a457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a1ba69-98d0-4143-a7aa-ec8fec86c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a1ba69-98d0-4143-a7aa-ec8fec86c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f6e845-9cb7-4543-be14-6d2bffc8e6ad', 'volume_name': 'volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b525ff8-a245-47bc-9ad3-74887c903bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b525ff8-a245-47bc-9ad3-74887c903bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc6747f-f978-4180-84a6-4c3b8528419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad', 'volume_size': 1} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-620392051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f6e845-9cb7-4543-be14-6d2bffc8e6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89522ed4b70d422b9f0a1a47b281fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:05Z,use_quota=True,user_id='663a5e00952b4768961ed471bbc999bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Creating volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:05 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:23:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:05 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad 1073741824 Sep 28 17:23:05 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad 1073741824" returned: 0 in 0.745s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad Sep 28 17:23:06 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" returned: 0 in 0.489s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc6747f-f978-4180-84a6-4c3b8528419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ee6fa2-d437-49ce-aad2-a7f04a2f536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:06 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Volume volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad (e6f6e845-9cb7-4543-be14-6d2bffc8e6ad): created successfully Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ee6fa2-d437-49ce-aad2-a7f04a2f536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (aa47e3ec-317f-4eca-a9fc-1ea13bbfc483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-27c7af2a-f816-42e2-9f6a-2d91ee1b410c tempest-VolumesDeleteCascade-747994621 None] Created volume successfully. Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:07 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Creating offline snapshot d2257370-86c7-4224-a771-ce00dfacf8ef of volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ae60a-2493-4e18-990f-1e71700dba91]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad Sep 28 17:23:08 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.610s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:08 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" returned: 0 in 0.663s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef 1G Sep 28 17:23:08 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:09 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef 1G" returned: 0 in 1.140s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:09 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.693s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef is being set with open permissions: ugo+rw Sep 28 17:23:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:10 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.637s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info Sep 28 17:23:11 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info" returned: 0 in 0.514s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info is being set with open permissions: ugo+rw Sep 28 17:23:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info Sep 28 17:23:11 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.info" returned: 0 in 0.603s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.480s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8b96a6d0-d1f8-47f2-8a67-0c03db833394 tempest-VolumesDeleteCascade-747994621 None] Create snapshot completed successfully Sep 28 17:23:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Creating offline snapshot 342da066-f5b4-4ee9-95d8-120550a3e004 of volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:13 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f0b99a-86ff-4ae8-bfc1-f85bdd7beab7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:14 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.972s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 1G Sep 28 17:23:14 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:15 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 1G" returned: 0 in 0.982s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:15 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 Sep 28 17:23:15 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:16 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004" returned: 0 in 0.716s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:16 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 is being set with open permissions: ugo+rw Sep 28 17:23:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:16 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 Sep 28 17:23:16 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:17 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004" returned: 0 in 0.713s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.612s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Flow 'volume_create_manager' (1bb1fc10-8049-4f94-994c-208385ae1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729c67e2-88b9-4528-96cf-cef7f8a0d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729c67e2-88b9-4528-96cf-cef7f8a0d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fc53a4-db55-417e-943b-2afc05b97440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5fb2cb2171489196c405aac223a21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:17Z,use_quota=True,user_id='1e33644e443141a5a404990a5f83442f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e06b4f-4c04-406f-a35e-1cb423563b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e06b4f-4c04-406f-a35e-1cb423563b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be7dc56-c087-4928-ad89-7968f8beb0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:23:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ae64dbf1-f7d8-4f6d-b798-aff1344e233b tempest-VolumesDeleteCascade-747994621 None] Create snapshot completed successfully Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be7dc56-c087-4928-ad89-7968f8beb0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8fc53a4-db55-417e-943b-2afc05b97440', 'volume_name': 'volume-f8fc53a4-db55-417e-943b-2afc05b97440', 'volume_size': 1, 'image_id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42e35327982c102325668d5c40a8611a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d5fb2cb2171489196c405aac223a21a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fffc8b41aa63a26f44ec9d18f614563c24aa4bea8393004f3cc9707b0e92654857b7e2fcb246e61b175e4ae80936b92eba862862ca1d3fe6f110dfc1f535ed4', 'id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'created_at': datetime.datetime(2026, 9, 28, 15, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25960a5-f51b-4a72-b617-b1cad4df8d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25960a5-f51b-4a72-b617-b1cad4df8d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b3c509-d913-47a5-a734-1253bae3e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Volume f8fc53a4-db55-417e-943b-2afc05b97440: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8fc53a4-db55-417e-943b-2afc05b97440', 'volume_size': 1, 'image_id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42e35327982c102325668d5c40a8611a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d5fb2cb2171489196c405aac223a21a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fffc8b41aa63a26f44ec9d18f614563c24aa4bea8393004f3cc9707b0e92654857b7e2fcb246e61b175e4ae80936b92eba862862ca1d3fe6f110dfc1f535ed4', 'id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'created_at': datetime.datetime(2026, 9, 28, 15, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753/file', 'properties': {}}, 'image_service': } Sep 28 17:23:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Trying to clone f8fc53a4-db55-417e-943b-2afc05b97440 from image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:23:18 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644f39b-a211-45e4-aea9-8e0760b621c5]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Performing cascade delete. {{(pid=86929) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-342da066-f5b4-4ee9-95d8-120550a3e004-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-342da066-f5b4-4ee9-95d8-120550a3e004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:18 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:18 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-342da066-f5b4-4ee9-95d8-120550a3e004" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-342da066-f5b4-4ee9-95d8-120550a3e004" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Deleting offline snapshot 342da066-f5b4-4ee9-95d8-120550a3e004 of volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] snapshot_file for this snap is: volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c422e-c78a-4140-8d62-2370217f5d2c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 Sep 28 17:23:19 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:19 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004" returned: 0 in 0.940s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0616849-3d1d-40fb-94f5-7728330ea04c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 1 in 0.893s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Temporary image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 is fetched for user 1e33644e443141a5a404990a5f83442f. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fb0c33-7bf4-499c-9c8f-3f6ff42e24e2]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:20 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:20 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.767s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:20 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 Sep 28 17:23:20 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:20 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:20 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 1 in 0.744s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fc53a4-db55-417e-943b-2afc05b97440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5fb2cb2171489196c405aac223a21a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:17Z,use_quota=True,user_id='1e33644e443141a5a404990a5f83442f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Creating volume f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:21 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1073741824 Sep 28 17:23:21 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004" returned: 0 in 0.761s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004 Sep 28 17:23:21 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.342da066-f5b4-4ee9-95d8-120550a3e004" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-342da066-f5b4-4ee9-95d8-120550a3e004" released by "_delete_snapshot" :: held 3.138s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" released by "delete_snapshot" :: held 3.199s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Created reservations ['4c726091-0424-4668-9103-ade4bd5cc780', '9e847bd2-4812-4edf-9013-32e7d4ec46d6', '8c985e85-e808-42be-ac58-b2b9488c05ec', '4a2d4065-7634-4ac3-9e5a-ce6f7e0ed5ff'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:22 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1073741824" returned: 0 in 0.814s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 Sep 28 17:23:22 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Delete snapshot completed successfully. Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-342da066-f5b4-4ee9-95d8-120550a3e004-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-d2257370-86c7-4224-a771-ce00dfacf8ef-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-d2257370-86c7-4224-a771-ce00dfacf8ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-d2257370-86c7-4224-a771-ce00dfacf8ef" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-d2257370-86c7-4224-a771-ce00dfacf8ef" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Deleting offline snapshot d2257370-86c7-4224-a771-ce00dfacf8ef of volume e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] snapshot_file for this snap is: volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48fe5d4-22a7-4bcd-b2b9-b37b3fbf62cf]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:22 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440" returned: 0 in 0.407s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Attempting download of 23cec241-9acf-4a7d-bed8-0cbe08b5f753 ((None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}])) to volume f8fc53a4-db55-417e-943b-2afc05b97440. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c358d8d2-e9d7-4bf9-abcf-cc726054ec61]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.536s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:22 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp Sep 28 17:23:22 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c841681-872f-4ff9-840a-56581f6ba6d9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad Sep 28 17:23:23 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp" returned: 0 in 0.680s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp Sep 28 17:23:23 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" returned: 0 in 0.712s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:23 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp" returned: 1 in 0.662s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23cec241-9acf-4a7d-bed8-0cbe08b5f753_jf990uzp' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27023cfe-6268-4543-b2ef-7c1da2770211]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:24 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.690s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef Sep 28 17:23:24 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:24 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD Sep 28 17:23:24 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad.d2257370-86c7-4224-a771-ce00dfacf8ef" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-d2257370-86c7-4224-a771-ce00dfacf8ef" released by "_delete_snapshot" :: held 2.470s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" released by "delete_snapshot" :: held 2.506s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Created reservations ['04977dfd-df8b-43ea-a349-2fbab646e289', 'b93a3bb8-363a-4cf1-b72c-6204bd165fac', '3beb261a-8e22-4adb-9d69-098a78fe2ea6', '129c3f07-ddc1-43de-94c5-8f9dbd94d6f3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Delete snapshot completed successfully. Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-d2257370-86c7-4224-a771-ce00dfacf8ef-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Snapshots deleted, issuing volume delete {{(pid=86929) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:25 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD" returned: 1 in 0.596s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] 23cec241-9acf-4a7d-bed8-0cbe08b5f753 was raw, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8b1213-e311-4732-946f-6eb9d5b5b65e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 Sep 28 17:23:25 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad Sep 28 17:23:25 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" returned: 0 in 0.568s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad Sep 28 17:23:25 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440" returned: 0 in 0.629s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23cec241-9acf-4a7d-bed8-0cbe08b5f753_ry_5ezladevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:23:25 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:23:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1G Sep 28 17:23:25 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad" released by "delete_volume" :: held 1.115s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Created reservations ['9a9c910d-0d5b-4ddc-bbd6-d5d7578ffd69', 'bb02e832-879c-42f7-83b6-ffe62b54217a', '258d5fe5-f7d3-4119-8a63-aa1454ad029a', '137f80bb-6543-4921-bb7c-97f2c9b7f0a4'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:26 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 1G" returned: 0 in 0.541s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Downloaded image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 ((None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}])) to volume f8fc53a4-db55-417e-943b-2afc05b97440 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Temporary image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 for user 1e33644e443141a5a404990a5f83442f is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Marking volume f8fc53a4-db55-417e-943b-2afc05b97440 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Copying metadata from image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 to f8fc53a4-db55-417e-943b-2afc05b97440. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Creating volume glance metadata for volume f8fc53a4-db55-417e-943b-2afc05b97440 backed by image 23cec241-9acf-4a7d-bed8-0cbe08b5f753 with: {'image_id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '42e35327982c102325668d5c40a8611a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:26 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b3c509-d913-47a5-a734-1253bae3e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fc53a4-db55-417e-943b-2afc05b97440', 'volume_size': 1, 'image_id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '42e35327982c102325668d5c40a8611a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0d5fb2cb2171489196c405aac223a21a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fffc8b41aa63a26f44ec9d18f614563c24aa4bea8393004f3cc9707b0e92654857b7e2fcb246e61b175e4ae80936b92eba862862ca1d3fe6f110dfc1f535ed4', 'id': '23cec241-9acf-4a7d-bed8-0cbe08b5f753', 'created_at': datetime.datetime(2026, 9, 28, 15, 23, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 23, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23cec241-9acf-4a7d-bed8-0cbe08b5f753/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57291f9b-50dd-497f-aad5-138ab19f0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:26 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Volume volume-f8fc53a4-db55-417e-943b-2afc05b97440 (f8fc53a4-db55-417e-943b-2afc05b97440): created successfully Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57291f9b-50dd-497f-aad5-138ab19f0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Flow 'volume_create_manager' (1bb1fc10-8049-4f94-994c-208385ae1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-01a67c2c-4325-4232-89a6-6441fb3b2764 tempest-VolumeImageDependencyTests-1112863204 None] Created volume successfully. Sep 28 17:23:26 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Deleted volume successfully. Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-357df685-ca44-434d-a564-cf0b439f5bc6 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-e6f6e845-9cb7-4543-be14-6d2bffc8e6ad-delete_volume" released by "delete_volume" :: held 8.701s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Acquiring lock "cinder-f8fc53a4-db55-417e-943b-2afc05b97440-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "cinder-f8fc53a4-db55-417e-943b-2afc05b97440-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Acquiring lock "cinder-quobyte-f8fc53a4-db55-417e-943b-2afc05b97440" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "cinder-quobyte-f8fc53a4-db55-417e-943b-2afc05b97440" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d40fe-34d9-4af7-8c9a-efa7d43a2bbe]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 Sep 28 17:23:27 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (14cdd757-1a9c-41cf-9b2a-aa2c13e6e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbe594c-ad09-4911-b79a-c63869fa3d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbe594c-ad09-4911-b79a-c63869fa3d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-593465782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8426c458-fb29-4e4f-95d4-9ad550f79029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89522ed4b70d422b9f0a1a47b281fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:28Z,use_quota=True,user_id='663a5e00952b4768961ed471bbc999bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed28fb6-59c9-4476-8ed1-9e48b8438c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed28fb6-59c9-4476-8ed1-9e48b8438c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e0d23a-82b0-42a3-a407-3eb0cb19d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e0d23a-82b0-42a3-a407-3eb0cb19d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8426c458-fb29-4e4f-95d4-9ad550f79029', 'volume_name': 'volume-8426c458-fb29-4e4f-95d4-9ad550f79029', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56b8ab2-213d-434e-b85f-aa61d31b22b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56b8ab2-213d-434e-b85f-aa61d31b22b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56eed8e-db6c-4281-b26d-a41961684e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Volume 8426c458-fb29-4e4f-95d4-9ad550f79029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8426c458-fb29-4e4f-95d4-9ad550f79029', 'volume_size': 1} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-593465782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8426c458-fb29-4e4f-95d4-9ad550f79029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89522ed4b70d422b9f0a1a47b281fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:28Z,use_quota=True,user_id='663a5e00952b4768961ed471bbc999bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Creating volume 8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:28 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440" returned: 0 in 0.646s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 1073741824 Sep 28 17:23:28 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440 Sep 28 17:23:28 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f8fc53a4-db55-417e-943b-2afc05b97440" returned: 0 in 0.397s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "cinder-quobyte-f8fc53a4-db55-417e-943b-2afc05b97440" released by "delete_volume" :: held 1.153s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:28 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Created reservations ['cd92d0e8-a4aa-4041-960f-d3283083b0cd', 'e9e98cbe-d56d-4692-b933-9ccabc5b7d1f', '690c3586-61ad-4182-b48f-624bdf68941a', '0d42bb80-aa80-421f-b210-89b171a0546e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:29 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 1073741824" returned: 0 in 0.776s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:29 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.358s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Deleted volume successfully. Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cec90fa6-b7f8-4ed9-89c6-9e01f97f4e6c tempest-VolumeImageDependencyTests-1112863204 None] Lock "cinder-f8fc53a4-db55-417e-943b-2afc05b97440-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:29 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 0.340s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b56eed8e-db6c-4281-b26d-a41961684e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8426c458-fb29-4e4f-95d4-9ad550f79029', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2b016-3022-4083-8c6c-d315845d9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Volume volume-8426c458-fb29-4e4f-95d4-9ad550f79029 (8426c458-fb29-4e4f-95d4-9ad550f79029): created successfully Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2b016-3022-4083-8c6c-d315845d9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (14cdd757-1a9c-41cf-9b2a-aa2c13e6e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5f66b52a-df48-4b63-9e02-4026d417eaff tempest-VolumesDeleteCascade-747994621 None] Created volume successfully. Sep 28 17:23:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Creating offline snapshot aa9c45b4-5f5d-4e3c-8db7-68d478061077 of volume 8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e173de0e-7f2a-4d61-9bce-94bb017a6baa]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:30 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 0.739s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 1G Sep 28 17:23:31 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 1G" returned: 0 in 0.685s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426c458-fb29-4e4f-95d4-9ad550f79029 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426c458-fb29-4e4f-95d4-9ad550f79029 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:32 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:32 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8426c458-fb29-4e4f-95d4-9ad550f79029 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 0.684s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:32 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 is being set with open permissions: ugo+rw Sep 28 17:23:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:32 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:32 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 0.547s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=131,cinder:SELECT=116,cinder:INSERT=46,cinder:DELETE=12 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=112,cinder:UPDATE=150,cinder:INSERT=43,cinder:DELETE=11 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:33 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info Sep 28 17:23:33 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:33 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info" returned: 0 in 0.569s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:33 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info is being set with open permissions: ugo+rw Sep 28 17:23:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:34 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info Sep 28 17:23:34 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:34 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.info" returned: 0 in 0.608s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.098s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-96c3ad28-04c5-4e85-9110-bcf0682ce165 tempest-VolumesDeleteCascade-747994621 None] Create snapshot completed successfully Sep 28 17:23:35 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (29f323de-12e4-4923-aee7-82c6e6dcb67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2b17b0-b0b6-4e35-930e-ec7d22ccf975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2b17b0-b0b6-4e35-930e-ec7d22ccf975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-906927310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036c75f0-a0b5-4dc3-b036-3574de9bca49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89522ed4b70d422b9f0a1a47b281fcb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa9c45b4-5f5d-4e3c-8db7-68d478061077,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:36Z,use_quota=True,user_id='663a5e00952b4768961ed471bbc999bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd78ccc3-4a13-4f82-bc6b-8c6b8f50e0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd78ccc3-4a13-4f82-bc6b-8c6b8f50e0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be775dd-fdea-43f0-a657-5621a753e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be775dd-fdea-43f0-a657-5621a753e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '036c75f0-a0b5-4dc3-b036-3574de9bca49', 'volume_name': 'volume-036c75f0-a0b5-4dc3-b036-3574de9bca49', 'volume_size': 1, 'snapshot_id': 'aa9c45b4-5f5d-4e3c-8db7-68d478061077'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2dd67-1eee-4bde-afcd-cb0f931217c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2dd67-1eee-4bde-afcd-cb0f931217c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ec11af-fffa-47ae-8213-4b63f7c3765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Volume 036c75f0-a0b5-4dc3-b036-3574de9bca49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-036c75f0-a0b5-4dc3-b036-3574de9bca49', 'volume_size': 1, 'snapshot_id': 'aa9c45b4-5f5d-4e3c-8db7-68d478061077'} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077-036c75f0-a0b5-4dc3-b036-3574de9bca49" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077-036c75f0-a0b5-4dc3-b036-3574de9bca49" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Creating volume 036c75f0-a0b5-4dc3-b036-3574de9bca49 from snapshot aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] snapshot: aa9c45b4-5f5d-4e3c-8db7-68d478061077, volume: 036c75f0-a0b5-4dc3-b036-3574de9bca49, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b84bfe-b9fd-41b8-a56b-5c6446d523c6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:36 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:36 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:36 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 0.671s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8426c458-fb29-4e4f-95d4-9ad550f79029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ffff81-ad83-4e1c-ac81-8c69808976f4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:37 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 0.594s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:23:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:23:37 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:23:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 Sep 28 17:23:37 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:46 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:46 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Flow 'volume_create_manager' (96ab92fb-3c69-43ef-9897-1b256cf78025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bc78b-f807-48bb-ab53-2d243c03afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bc78b-f807-48bb-ab53-2d243c03afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-284172608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a546b17-c777-495c-b211-83c8144671eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58632f89c11040c0967f1b83bb398e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:50Z,use_quota=True,user_id='b667fe63c4a74c148df645b7dc792f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6a809d-945d-4d5d-8eb5-c6eee8fbd6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6a809d-945d-4d5d-8eb5-c6eee8fbd6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67cf70c-595f-49bd-a1d6-8514f1533819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67cf70c-595f-49bd-a1d6-8514f1533819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a546b17-c777-495c-b211-83c8144671eb', 'volume_name': 'volume-7a546b17-c777-495c-b211-83c8144671eb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c4c6b-7f29-42c9-ae61-53099e0118de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3c4c6b-7f29-42c9-ae61-53099e0118de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284693e4-0d4d-4079-bc52-c77bb37e4a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Volume 7a546b17-c777-495c-b211-83c8144671eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a546b17-c777-495c-b211-83c8144671eb', 'volume_size': 1} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:49 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49" returned: 0 in 12.386s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029, size 1024.00 MB, duration 12.39 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:23:49 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Converted 1024.00 MB image at 82.67 MB/s Sep 28 17:23:49 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 is being set with open permissions: ugo+rw Sep 28 17:23:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:50 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 Sep 28 17:23:50 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:50 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49" returned: 0 in 0.353s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" released by "_copy_volume_from_snapshot" :: held 14.182s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077-036c75f0-a0b5-4dc3-b036-3574de9bca49" released by "_create_volume_from_snapshot" :: held 14.391s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.422s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-284172608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a546b17-c777-495c-b211-83c8144671eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58632f89c11040c0967f1b83bb398e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:50Z,use_quota=True,user_id='b667fe63c4a74c148df645b7dc792f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Creating volume 7a546b17-c777-495c-b211-83c8144671eb {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:50 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:50 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb 1073741824 Sep 28 17:23:50 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ec11af-fffa-47ae-8213-4b63f7c3765c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036c75f0-a0b5-4dc3-b036-3574de9bca49', 'volume_size': 1, 'snapshot_id': 'aa9c45b4-5f5d-4e3c-8db7-68d478061077'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb35ec3-eaf4-49c0-b5d8-e3a9f3ae0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:50 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Volume volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 (036c75f0-a0b5-4dc3-b036-3574de9bca49): created successfully Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb35ec3-eaf4-49c0-b5d8-e3a9f3ae0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Flow 'volume_create_manager' (29f323de-12e4-4923-aee7-82c6e6dcb67a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2ae9b720-883d-45d8-b075-36d217d1b852 tempest-VolumesDeleteCascade-747994621 None] Created volume successfully. Sep 28 17:23:51 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb 1073741824" returned: 0 in 0.690s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:51 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb Sep 28 17:23:51 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-8426c458-fb29-4e4f-95d4-9ad550f79029-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-8426c458-fb29-4e4f-95d4-9ad550f79029-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Performing cascade delete. {{(pid=86929) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-aa9c45b4-5f5d-4e3c-8db7-68d478061077-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-aa9c45b4-5f5d-4e3c-8db7-68d478061077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Deleting offline snapshot aa9c45b4-5f5d-4e3c-8db7-68d478061077 of volume 8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] snapshot_file for this snap is: volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47034b-b569-4bb5-ac29-866d7a41a4d2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:52 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb" returned: 0 in 0.742s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284693e4-0d4d-4079-bc52-c77bb37e4a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a546b17-c777-495c-b211-83c8144671eb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90de539c-a057-44e0-bec4-c5b04190be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Volume volume-7a546b17-c777-495c-b211-83c8144671eb (7a546b17-c777-495c-b211-83c8144671eb): created successfully Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90de539c-a057-44e0-bec4-c5b04190be48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Flow 'volume_create_manager' (96ab92fb-3c69-43ef-9897-1b256cf78025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:52 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-24638e00-1a53-4f4d-90d8-2c50955b0856 tempest-TestMinimumBasicScenario-1223863106 None] Created volume successfully. Sep 28 17:23:52 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:53 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 1.391s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8426c458-fb29-4e4f-95d4-9ad550f79029(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e486ca9a-005d-408d-9779-5f8bf0700b2e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:53 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:53 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 1.079s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:54 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:54 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:54 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 0.655s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-1f2918b6-e0de-4794-b5dc-d9b97327bb7d req-a7fa1bbe-1d2b-4f1a-a571-4f7384154479 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-1f2918b6-e0de-4794-b5dc-d9b97327bb7d req-a7fa1bbe-1d2b-4f1a-a571-4f7384154479 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:55 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077 Sep 28 17:23:55 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-1f2918b6-e0de-4794-b5dc-d9b97327bb7d req-a7fa1bbe-1d2b-4f1a-a571-4f7384154479 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-1f2918b6-e0de-4794-b5dc-d9b97327bb7d req-a7fa1bbe-1d2b-4f1a-a571-4f7384154479 tempest-TestMinimumBasicScenario-1223863106 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-7a546b17-c777-495c-b211-83c8144671eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e898409b-f6e6-45c8-998b-4aab9c3f9a3e', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:23:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-1f2918b6-e0de-4794-b5dc-d9b97327bb7d req-a7fa1bbe-1d2b-4f1a-a571-4f7384154479 tempest-TestMinimumBasicScenario-1223863106 None] attachment_update completed successfully. Sep 28 17:23:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-32215132-eb7b-4df3-a387-462818ecbb87 tempest-TestShelveInstance-1591534832 None] Terminate volume connection completed successfully. Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-32215132-eb7b-4df3-a387-462818ecbb87 tempest-TestShelveInstance-1591534832 None] Deleting attachment 23b5a041-a146-457d-be58-f47607dceb2c. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:23:55 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029.aa9c45b4-5f5d-4e3c-8db7-68d478061077" returned: 0 in 0.594s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-aa9c45b4-5f5d-4e3c-8db7-68d478061077" released by "_delete_snapshot" :: held 3.958s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" released by "delete_snapshot" :: held 4.029s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Acquiring lock "cinder-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "cinder-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Acquiring lock "cinder-quobyte-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "cinder-quobyte-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" acquired by "delete_volume" :: waited 0.048s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Created reservations ['b44149e9-f6cc-45bd-8817-fcec90940c58', 'd24ee604-9922-44e3-93f4-558ceb2619b7', 'a49a434c-93b2-434e-9fdd-4054cb733991', '64c48891-9443-48d4-b4ac-65983dca3930'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a751bc04-07b9-4ad5-99f4-f00a61441df2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Delete snapshot completed successfully. Sep 28 17:23:56 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 Sep 28 17:23:56 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-aa9c45b4-5f5d-4e3c-8db7-68d478061077-delete_snapshot" released by "delete_snapshot" :: held 4.601s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Snapshots deleted, issuing volume delete {{(pid=86929) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[061deba1-f1b3-4be2-936f-175428efe224]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:56 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:56 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" returned: 0 in 0.775s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:56 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0 Sep 28 17:23:56 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 0.801s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:57 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" returned: 0 in 0.472s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029 Sep 28 17:23:57 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "cinder-quobyte-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0" released by "delete_volume" :: held 1.362s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.quota [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Created reservations ['a1961d14-9848-41f5-8630-ce50fb044608', '08461a4d-1826-4c33-aa1f-09dff7e2da69', 'd52f1940-3381-4bd9-b03c-cf92e9e9f56e', 'defc79d6-386d-4900-bd03-43656752d2d7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:57 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:57 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:57 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8426c458-fb29-4e4f-95d4-9ad550f79029" returned: 0 in 0.513s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-8426c458-fb29-4e4f-95d4-9ad550f79029" released by "delete_volume" :: held 1.462s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Created reservations ['99073d9c-2d2e-46de-a4c9-d7e9218b9e62', '2e7d6bf6-39c5-4797-ab17-8be16fee35c5', '00ea0663-b442-4e3e-9458-f668819898b1', '6573bf07-6d6f-47a6-88b6-ceef7ae6623a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:57 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.354s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.manager [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Deleted volume successfully. Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [req-19e3935d-900e-40f9-b109-cd02cd08a72d req-dcf3accc-466b-4c12-9192-df8c55a33413 tempest-TestShelveInstance-1591534832 None] Lock "cinder-ba4dbc4b-7ebd-404d-8784-6eca0422b3b0-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:23:58 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Deleted volume successfully. Sep 28 17:23:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e2bea4e5-df9b-4e52-8c52-9da91799876d tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-8426c458-fb29-4e4f-95d4-9ad550f79029-delete_volume" released by "delete_volume" :: held 7.036s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-036c75f0-a0b5-4dc3-b036-3574de9bca49-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-036c75f0-a0b5-4dc3-b036-3574de9bca49-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[30162a84-a495-46ff-84ef-a33e78f1d5c5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 Sep 28 17:23:59 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49" returned: 0 in 0.667s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49 Sep 28 17:23:59 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-036c75f0-a0b5-4dc3-b036-3574de9bca49" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-quobyte-036c75f0-a0b5-4dc3-b036-3574de9bca49" released by "delete_volume" :: held 1.168s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Created reservations ['1e129c95-8802-4cd3-aed3-5d3650a5c2a0', 'b3b41f12-c3b8-496a-a60e-ff458a571a59', 'c4bdfa40-393c-46b9-97b7-5ed8606628be', '08cd2476-06e6-4201-8be9-054fa6905dd0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:24:00 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.311s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Deleted volume successfully. Sep 28 17:24:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f318daa5-1ec4-4e4b-a06d-08de895c9898 tempest-VolumesDeleteCascade-747994621 None] Lock "cinder-036c75f0-a0b5-4dc3-b036-3574de9bca49-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Flow 'volume_create_manager' (bad4bd25-cd66-4e61-87f1-db3a7bf3be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80470f9a-d2a2-4d90-877c-dc3038b619ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80470f9a-d2a2-4d90-877c-dc3038b619ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-272638252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6b7f9-7a64-473f-8edb-6d56b3cb106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef6c4035aff4d19a2d34c800803acea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:07Z,use_quota=True,user_id='5ee6fa66a3fe4f9796c2e4edbeb05d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdffe20d-73c3-4f11-8ef7-82f7579ee7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdffe20d-73c3-4f11-8ef7-82f7579ee7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bced909-d9f7-4623-b472-49446fb4b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bced909-d9f7-4623-b472-49446fb4b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c6b7f9-7a64-473f-8edb-6d56b3cb106a', 'volume_name': 'volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120f06f6-0c30-4f66-bc98-33db1f0fa1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120f06f6-0c30-4f66-bc98-33db1f0fa1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77de4883-7850-4936-a7f2-621906cc9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:07 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Volume 44c6b7f9-7a64-473f-8edb-6d56b3cb106a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a', 'volume_size': 1} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-272638252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c6b7f9-7a64-473f-8edb-6d56b3cb106a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ef6c4035aff4d19a2d34c800803acea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:07Z,use_quota=True,user_id='5ee6fa66a3fe4f9796c2e4edbeb05d14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Creating volume 44c6b7f9-7a64-473f-8edb-6d56b3cb106a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:07 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a 1073741824 Sep 28 17:24:07 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:07 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:24:07 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:07 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.361s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:08 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a 1073741824" returned: 0 in 0.783s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:08 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a Sep 28 17:24:08 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:08 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77de4883-7850-4936-a7f2-621906cc9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedf8c79-de29-4752-b477-00d2d5d2499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:08 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Volume volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a (44c6b7f9-7a64-473f-8edb-6d56b3cb106a): created successfully Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedf8c79-de29-4752-b477-00d2d5d2499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Flow 'volume_create_manager' (bad4bd25-cd66-4e61-87f1-db3a7bf3be5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-554b11de-5035-4069-b78e-0eec06317f1d tempest-VolumesMetadataTest-842764526 None] Created volume successfully. Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Acquiring lock "cinder-44c6b7f9-7a64-473f-8edb-6d56b3cb106a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "cinder-44c6b7f9-7a64-473f-8edb-6d56b3cb106a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Acquiring lock "cinder-quobyte-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "cinder-quobyte-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f674d154-e7cc-4fd5-9362-385434363de5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:10 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a Sep 28 17:24:10 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" returned: 0 in 0.501s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a Sep 28 17:24:11 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:11 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" returned: 0 in 0.400s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "cinder-quobyte-44c6b7f9-7a64-473f-8edb-6d56b3cb106a" released by "delete_volume" :: held 0.977s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Created reservations ['5ade3eb8-b697-45ec-9932-5390f88a3837', 'bff52768-2c94-4f19-a094-58ccd8639839', '97afb7b2-bf48-4813-b616-1ba542edd185', 'c0ff6148-c504-4003-b3b7-dd48179b7271'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:11 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:24:11 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:12 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.399s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:12 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Deleted volume successfully. Sep 28 17:24:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-00fbce23-a502-4eae-b441-07c966dfc185 tempest-VolumesMetadataTest-842764526 None] Lock "cinder-44c6b7f9-7a64-473f-8edb-6d56b3cb106a-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Flow 'volume_create_manager' (bc283972-5c4d-4f4e-8982-39ab5a3a8009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1831e11-6c0b-48ca-ba6c-bac54a6b21d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1831e11-6c0b-48ca-ba6c-bac54a6b21d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1872509825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa685e8-2e6a-403b-9702-4fb3072304e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3864b34e84484910e8c22c6d8d5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:18Z,use_quota=True,user_id='ddad6808761d49a19b46968b0e010ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995c5acf-f2ca-4bcf-9200-2fb79559144d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995c5acf-f2ca-4bcf-9200-2fb79559144d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3ac3ac-5f86-41e0-84f3-331c9726bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3ac3ac-5f86-41e0-84f3-331c9726bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7aa685e8-2e6a-403b-9702-4fb3072304e0', 'volume_name': 'volume-7aa685e8-2e6a-403b-9702-4fb3072304e0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4e801c-03e5-477d-aced-850c5e12e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4e801c-03e5-477d-aced-850c5e12e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c078a0-ee8b-41ca-a8e4-c7b9850b7239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Volume 7aa685e8-2e6a-403b-9702-4fb3072304e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7aa685e8-2e6a-403b-9702-4fb3072304e0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:24:18 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Trying to clone 7aa685e8-2e6a-403b-9702-4fb3072304e0 from image fa438d18-3930-42ab-a121-0871daf80309 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:24:19 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:24:19 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:24:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93f0cc-2fbd-4d74-af52-342a78d23229]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD Sep 28 17:24:19 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 is fetched for user ddad6808761d49a19b46968b0e010ca8. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0559625-8770-416e-ab2a-44fc0cb1f98f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD Sep 28 17:24:20 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1872509825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa685e8-2e6a-403b-9702-4fb3072304e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3864b34e84484910e8c22c6d8d5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:18Z,use_quota=True,user_id='ddad6808761d49a19b46968b0e010ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Creating volume 7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:20 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:24:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1073741824 Sep 28 17:24:20 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1073741824" returned: 0 in 0.627s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 Sep 28 17:24:21 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0" returned: 0 in 0.397s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Attempting download of fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 7aa685e8-2e6a-403b-9702-4fb3072304e0. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb528821-7ae0-4daf-a0f3-be49008dc9e9]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6 Sep 28 17:24:21 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6" returned: 0 in 0.476s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6 Sep 28 17:24:22 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6" returned: 1 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_ua8nakm6' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f506f8d-832d-410b-af52-6c36c239eec0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD Sep 28 17:24:22 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:23 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:23 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] fa438d18-3930-42ab-a121-0871daf80309 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:24:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 Sep 28 17:24:23 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:26 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0" returned: 0 in 2.930s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_glg9sesydevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:26 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Converted 112.00 MB image at 38.16 MB/s Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:26 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1G Sep 28 17:24:26 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:26 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 1G" returned: 0 in 0.511s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Downloaded image fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 7aa685e8-2e6a-403b-9702-4fb3072304e0 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 for user ddad6808761d49a19b46968b0e010ca8 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Marking volume 7aa685e8-2e6a-403b-9702-4fb3072304e0 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Copying metadata from image fa438d18-3930-42ab-a121-0871daf80309 to 7aa685e8-2e6a-403b-9702-4fb3072304e0. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Creating volume glance metadata for volume 7aa685e8-2e6a-403b-9702-4fb3072304e0 backed by image fa438d18-3930-42ab-a121-0871daf80309 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c078a0-ee8b-41ca-a8e4-c7b9850b7239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa685e8-2e6a-403b-9702-4fb3072304e0', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30651817-d4eb-4bbb-8c5d-09cf78961f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:26 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Volume volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 (7aa685e8-2e6a-403b-9702-4fb3072304e0): created successfully Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30651817-d4eb-4bbb-8c5d-09cf78961f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Flow 'volume_create_manager' (bc283972-5c4d-4f4e-8982-39ab5a3a8009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2c186abd-5336-4c52-95ee-a7ba8d7edbd9 tempest-VolumesExtendTest-1028232886 None] Created volume successfully. Sep 28 17:24:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:27 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[facbb7e4-5759-4984-984c-02a4bcc24452]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:27 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 Sep 28 17:24:27 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:28 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0" returned: 0 in 0.557s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 2G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 2G" returned: 0 in 0.294s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.895s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-22a6b328-fc07-4ac3-8b85-0ff1f0817d1f tempest-VolumesExtendTest-1028232886 None] Extend volume completed successfully. Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-7aa685e8-2e6a-403b-9702-4fb3072304e0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "cinder-7aa685e8-2e6a-403b-9702-4fb3072304e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-quobyte-7aa685e8-2e6a-403b-9702-4fb3072304e0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-7aa685e8-2e6a-403b-9702-4fb3072304e0" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fd641-173d-4a03-b1a5-ed49ad872bca]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:29 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 Sep 28 17:24:29 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:29 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0" returned: 0 in 0.458s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:29 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0 Sep 28 17:24:29 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:30 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7aa685e8-2e6a-403b-9702-4fb3072304e0" returned: 0 in 0.351s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-7aa685e8-2e6a-403b-9702-4fb3072304e0" released by "delete_volume" :: held 0.868s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Created reservations ['3e98ad51-d911-4288-a971-1c27176ae4f8', '96f4cdfd-e04b-4ee8-87cb-761a34ff8006', '1c7e2398-206f-4bc0-aabd-23be19d5998f', '0255c027-376c-40df-a301-6d083979773a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:30 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:24:30 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.640s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Deleted volume successfully. Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-570ab180-88f6-4f48-984e-83fdfdbd013e tempest-VolumesExtendTest-1028232886 None] Lock "cinder-7aa685e8-2e6a-403b-9702-4fb3072304e0-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Flow 'volume_create_manager' (a2ea2d9a-e551-4c81-8641-cbe911003ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e00223-00bb-4f86-a071-fb9a839ae6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e00223-00bb-4f86-a071-fb9a839ae6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-748457846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8fe931-709b-4741-9e88-9eebea5eddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3864b34e84484910e8c22c6d8d5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:31Z,use_quota=True,user_id='ddad6808761d49a19b46968b0e010ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8309806-6b12-457b-a03b-afa483e5e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8309806-6b12-457b-a03b-afa483e5e12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18e3de4-3c5e-4f85-bc59-b42f5a29ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18e3de4-3c5e-4f85-bc59-b42f5a29ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8fe931-709b-4741-9e88-9eebea5eddb2', 'volume_name': 'volume-3f8fe931-709b-4741-9e88-9eebea5eddb2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647cb7c4-be82-44de-a562-3db748103bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647cb7c4-be82-44de-a562-3db748103bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff179e6-e3c5-4179-a0b0-dc3899289748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Volume 3f8fe931-709b-4741-9e88-9eebea5eddb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8fe931-709b-4741-9e88-9eebea5eddb2', 'volume_size': 1} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-748457846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8fe931-709b-4741-9e88-9eebea5eddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98c3864b34e84484910e8c22c6d8d5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:31Z,use_quota=True,user_id='ddad6808761d49a19b46968b0e010ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Creating volume 3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:31 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:24:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 1073741824 Sep 28 17:24:31 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 1073741824" returned: 0 in 0.664s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:32 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:32 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff179e6-e3c5-4179-a0b0-dc3899289748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8fe931-709b-4741-9e88-9eebea5eddb2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f666b870-9dca-4181-9487-111d053f5aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Volume volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 (3f8fe931-709b-4741-9e88-9eebea5eddb2): created successfully Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f666b870-9dca-4181-9487-111d053f5aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Flow 'volume_create_manager' (a2ea2d9a-e551-4c81-8641-cbe911003ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:32 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-66e0cd2b-839e-4d69-a77f-beb8b18c9726 tempest-VolumesExtendTest-1028232886 None] Created volume successfully. Sep 28 17:24:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Creating offline snapshot f32639f7-1e17-487c-b659-3278ebaf5e6c of volume 3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a948b66-14b0-4910-b6cd-15cdaf923e02]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:33 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c 1G Sep 28 17:24:34 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:34 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c 1G" returned: 0 in 0.580s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:34 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c Sep 28 17:24:34 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c" returned: 0 in 0.432s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c is being set with open permissions: ugo+rw Sep 28 17:24:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c Sep 28 17:24:35 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c" returned: 0 in 0.325s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info Sep 28 17:24:35 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info" returned: 0 in 0.335s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:36 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info is being set with open permissions: ugo+rw Sep 28 17:24:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info Sep 28 17:24:36 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.info" returned: 0 in 0.300s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5ed40c45-f28a-4bd4-81c2-5d1b9ea4e031 tempest-VolumesExtendTest-1028232886 None] Create snapshot completed successfully Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0a445-3e06-40c3-a771-6f60a23d08dc]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:37 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:37 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.478s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c 2G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c 2G" returned: 0 in 0.162s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.692s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8588ecfb-d509-4189-9f93-a9420173d302 tempest-VolumesExtendTest-1028232886 None] Extend volume completed successfully. Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-f32639f7-1e17-487c-b659-3278ebaf5e6c-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-f32639f7-1e17-487c-b659-3278ebaf5e6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-quobyte-f32639f7-1e17-487c-b659-3278ebaf5e6c" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-f32639f7-1e17-487c-b659-3278ebaf5e6c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Deleting offline snapshot f32639f7-1e17-487c-b659-3278ebaf5e6c of volume 3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] snapshot_file for this snap is: volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c0756b-978e-4a05-928d-e475dc6c74d9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:38 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c Sep 28 17:24:38 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c" returned: 0 in 0.567s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8fe931-709b-4741-9e88-9eebea5eddb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537beef-8ac0-4d43-ac4f-ba1b48bac6f6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:39 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:39 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.520s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:39 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c Sep 28 17:24:39 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:40 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c" returned: 0 in 0.755s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:40 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c Sep 28 17:24:40 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:40 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2.f32639f7-1e17-487c-b659-3278ebaf5e6c" returned: 0 in 0.423s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-f32639f7-1e17-487c-b659-3278ebaf5e6c" released by "_delete_snapshot" :: held 2.435s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" released by "delete_snapshot" :: held 2.465s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:40 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Created reservations ['01aa61d8-326a-49c8-88a6-eb071cac60c2', 'e99f3ee3-9090-4133-a424-aee021e31420', '8f9c53cf-a94c-476f-87f4-e4abf898ef85', 'e7d8fcdc-7edb-4e24-9f1d-dc2a18d7f13a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Delete snapshot completed successfully. Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f7202d83-b78f-4b5e-8ee4-8aecd055986a tempest-VolumesExtendTest-1028232886 None] Lock "cinder-f32639f7-1e17-487c-b659-3278ebaf5e6c-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-3f8fe931-709b-4741-9e88-9eebea5eddb2-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "cinder-3f8fe931-709b-4741-9e88-9eebea5eddb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Acquiring lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52edd66-8b35-4824-9399-d90f7d18099a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:42 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:42 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.455s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:42 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2 Sep 28 17:24:42 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f8fe931-709b-4741-9e88-9eebea5eddb2" returned: 0 in 0.295s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "cinder-quobyte-3f8fe931-709b-4741-9e88-9eebea5eddb2" released by "delete_volume" :: held 0.832s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Created reservations ['74216d7a-00e3-4340-b121-de9a31216c39', '448b6493-6d47-4137-bfa4-df1f7b22355f', '3f0eb426-75e6-4db8-a004-fa26329fd861', '6e0e39b8-b24f-4c1d-a59b-19afcf73d600'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:42 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:24:42 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:43 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.394s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:43 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Deleted volume successfully. Sep 28 17:24:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a2a223bb-0bb1-4090-a034-5a980b09485d tempest-VolumesExtendTest-1028232886 None] Lock "cinder-3f8fe931-709b-4741-9e88-9eebea5eddb2-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=71,cinder:UPDATE=83,cinder:DELETE=8,cinder:INSERT=22 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=84,cinder:SELECT=74,cinder:INSERT=29,cinder:DELETE=4 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Flow 'volume_create_manager' (860f9828-6c8e-48b0-926e-f8c1b5d9cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d26cf8-8c11-4eed-a12c-57c5c4ae0c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d26cf8-8c11-4eed-a12c-57c5c4ae0c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1539197566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad514028-5d6e-48c7-bff6-9173a1508c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218b50ddade44e25b3a23cca69aa95ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:47Z,use_quota=True,user_id='8395eb99a7ea46f4ae06844af4912ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b9c10-235f-4dbd-9926-46c1c1b6a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245b9c10-235f-4dbd-9926-46c1c1b6a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4dec6b-f942-4bf9-b383-fc447cc76e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4dec6b-f942-4bf9-b383-fc447cc76e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad514028-5d6e-48c7-bff6-9173a1508c1a', 'volume_name': 'volume-ad514028-5d6e-48c7-bff6-9173a1508c1a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf00ce-68f0-4747-97cd-38a2896b64d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abf00ce-68f0-4747-97cd-38a2896b64d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d821cd94-01b3-40f0-b8df-ea9db4bf008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Volume ad514028-5d6e-48c7-bff6-9173a1508c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad514028-5d6e-48c7-bff6-9173a1508c1a', 'volume_size': 1} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1539197566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad514028-5d6e-48c7-bff6-9173a1508c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='218b50ddade44e25b3a23cca69aa95ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:47Z,use_quota=True,user_id='8395eb99a7ea46f4ae06844af4912ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Creating volume ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:47 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a 1073741824 Sep 28 17:24:47 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (b5f2374e-0828-408d-ae13-dc6c9e75650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9c240-2704-4fdc-af7e-721f4a3ac817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f9c240-2704-4fdc-af7e-721f4a3ac817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-260904553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0da13f-7f62-4765-8957-e8dae6ea5806,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:48Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50564791-551c-49eb-9e6c-32624adf8da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50564791-551c-49eb-9e6c-32624adf8da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efadf9e-a53b-4179-9f28-f7eb1943876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efadf9e-a53b-4179-9f28-f7eb1943876f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0da13f-7f62-4765-8957-e8dae6ea5806', 'volume_name': 'volume-bd0da13f-7f62-4765-8957-e8dae6ea5806', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0ada1c-cf7d-4304-ac3c-5b2e457f6d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0ada1c-cf7d-4304-ac3c-5b2e457f6d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5a6f7a-1513-4257-b17a-e89d9d8c91b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Volume bd0da13f-7f62-4765-8957-e8dae6ea5806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0da13f-7f62-4765-8957-e8dae6ea5806', 'volume_size': 1} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:48 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a 1073741824" returned: 0 in 0.546s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:48 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:24:48 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.333s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.458s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-260904553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0da13f-7f62-4765-8957-e8dae6ea5806,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:48Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Creating volume bd0da13f-7f62-4765-8957-e8dae6ea5806 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:48 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:48 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 1073741824 Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d821cd94-01b3-40f0-b8df-ea9db4bf008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad514028-5d6e-48c7-bff6-9173a1508c1a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c9530f-9bc7-4552-b89c-a4fe085dd89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Volume volume-ad514028-5d6e-48c7-bff6-9173a1508c1a (ad514028-5d6e-48c7-bff6-9173a1508c1a): created successfully Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c9530f-9bc7-4552-b89c-a4fe085dd89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Flow 'volume_create_manager' (860f9828-6c8e-48b0-926e-f8c1b5d9cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-400cdfa5-9310-4572-a962-3e2aec2df139 tempest-TestImageHashVerification-62487597 None] Created volume successfully. Sep 28 17:24:49 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 1073741824" returned: 0 in 0.512s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:49 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 Sep 28 17:24:49 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:49 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806" returned: 0 in 0.264s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5a6f7a-1513-4257-b17a-e89d9d8c91b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0da13f-7f62-4765-8957-e8dae6ea5806', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fb528c-ffe0-4837-9d26-71e339914dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Volume volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 (bd0da13f-7f62-4765-8957-e8dae6ea5806): created successfully Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fb528c-ffe0-4837-9d26-71e339914dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (b5f2374e-0828-408d-ae13-dc6c9e75650a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dd5a54a2-284c-432a-8c57-bb30ea6a7851 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d239d5-228b-40e9-ba2c-c2e7b0367ec7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:50 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:24:50 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (77a9f556-ecd6-4de0-8bb4-139ae267cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013f8592-25bd-4361-af9d-2dfac32fda4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013f8592-25bd-4361-af9d-2dfac32fda4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1058482375',display_name='tempest-VolumesGetTest-Volume-2106820149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b389752-69f2-41ae-88b5-05b0e979fbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:51Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8310ae-b7d0-44f7-8975-ef9f0d104f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8310ae-b7d0-44f7-8975-ef9f0d104f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5788614-9bfd-4b14-86ed-69afc4f47af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5788614-9bfd-4b14-86ed-69afc4f47af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b389752-69f2-41ae-88b5-05b0e979fbcc', 'volume_name': 'volume-1b389752-69f2-41ae-88b5-05b0e979fbcc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e84e6c7-666c-440a-9246-18d45b6b76f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e84e6c7-666c-440a-9246-18d45b6b76f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3906465a-8928-492f-9766-c7c2d6cea4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:50 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Volume 1b389752-69f2-41ae-88b5-05b0e979fbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b389752-69f2-41ae-88b5-05b0e979fbcc', 'volume_size': 1} Sep 28 17:24:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:51 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.414s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ee092-a9cd-4fc0-bfd3-116325342d71]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:24:51 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:51 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.418s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a /opt/stack/data/cinder/conversion/ad514028-5d6e-48c7-bff6-9173a1508c1a.temp_image.2348af62-2095-469a-a50f-843e5e187f36l9y246kv.img {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:51 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a /opt/stack/data/cinder/conversion/ad514028-5d6e-48c7-bff6-9173a1508c1a.temp_image.2348af62-2095-469a-a50f-843e5e187f36l9y246kv.img Sep 28 17:24:51 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:58 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a /opt/stack/data/cinder/conversion/ad514028-5d6e-48c7-bff6-9173a1508c1a.temp_image.2348af62-2095-469a-a50f-843e5e187f36l9y246kv.img" returned: 0 in 7.223s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec54050-9d76-4a9d-8380-5be2c77363f9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:58 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:24:58 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:59 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.645s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:59 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a, size 1024.00 MB, duration 7.22 sec, destination /opt/stack/data/cinder/conversion/ad514028-5d6e-48c7-bff6-9173a1508c1a.temp_image.2348af62-2095-469a-a50f-843e5e187f36l9y246kv.img {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:59 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Converted 1024.00 MB image at 141.75 MB/s Sep 28 17:24:59 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] 2348af62-2095-469a-a50f-843e5e187f36 was raw, no need to convert to raw {{(pid=86929) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:25:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-b5b98e95-6660-4211-931b-44cf14dd3599 req-eff599de-32c6-4bdc-8d9f-9ad1e513c549 tempest-TestMinimumBasicScenario-1223863106 None] Terminate volume connection completed successfully. Sep 28 17:25:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-b5b98e95-6660-4211-931b-44cf14dd3599 req-eff599de-32c6-4bdc-8d9f-9ad1e513c549 tempest-TestMinimumBasicScenario-1223863106 None] Deleting attachment e898409b-f6e6-45c8-998b-4aab9c3f9a3e. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "cinder-7a546b17-c777-495c-b211-83c8144671eb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "cinder-7a546b17-c777-495c-b211-83c8144671eb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "cinder-quobyte-7a546b17-c777-495c-b211-83c8144671eb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "cinder-quobyte-7a546b17-c777-495c-b211-83c8144671eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be051e-2588-474a-a126-07951ba2eaba]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb Sep 28 17:25:01 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:01 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb" returned: 0 in 0.433s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:01 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb Sep 28 17:25:01 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7a546b17-c777-495c-b211-83c8144671eb" returned: 0 in 0.303s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "cinder-quobyte-7a546b17-c777-495c-b211-83c8144671eb" released by "delete_volume" :: held 0.811s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Created reservations ['77aecaa9-5414-4270-a743-7234c7197439', '3263920f-545e-4e3e-a70a-8b87b2b75211', '1210e8d0-678f-47c0-b03a-b9e5cae5ced5', 'e71e530e-ca4b-4d46-a717-3d22c189e23b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:02 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:02 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:02 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.362s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Deleted volume successfully. Sep 28 17:25:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-002ebc44-7041-47f4-80cc-f1e821e4d857 tempest-TestMinimumBasicScenario-1223863106 None] Lock "cinder-7a546b17-c777-495c-b211-83c8144671eb-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:07 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:07 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:07 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.340s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:12 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:12 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Flow 'volume_create_manager' (b519311b-2041-44ba-aa37-e19f13b99651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d61f10c-8763-4b6c-940a-7f336a1c8b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d61f10c-8763-4b6c-940a-7f336a1c8b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-314991369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33c432f-4084-4174-bc6b-cd6708fd1d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc592e6b2814c9abfbd9b3edcdc66d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:21Z,use_quota=True,user_id='3fda53a0744642feb4b46db37ef53b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0309c6-caa6-4df8-b179-89da3ab74881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0309c6-caa6-4df8-b179-89da3ab74881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2902969-e9f3-4428-b135-aa39b6f64b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2902969-e9f3-4428-b135-aa39b6f64b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33c432f-4084-4174-bc6b-cd6708fd1d2b', 'volume_name': 'volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6149ab6f-bdbd-47e6-8772-9d7a9b21273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6149ab6f-bdbd-47e6-8772-9d7a9b21273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd92015a-80b1-4832-8892-5f1a2aba5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Volume a33c432f-4084-4174-bc6b-cd6708fd1d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b', 'volume_size': 1} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.194s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Uploaded volume to glance image-id: 2348af62-2095-469a-a50f-843e5e187f36. {{(pid=86929) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.851s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1058482375',display_name='tempest-VolumesGetTest-Volume-2106820149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b389752-69f2-41ae-88b5-05b0e979fbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:51Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Creating volume 1b389752-69f2-41ae-88b5-05b0e979fbcc {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:21 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:21 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc 1073741824 Sep 28 17:25:21 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9984dbf5-cb26-4a0a-bfa0-559b8756e2a4 tempest-TestImageHashVerification-62487597 None] Copy volume to image completed successfully. Sep 28 17:25:22 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc 1073741824" returned: 0 in 0.522s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:22 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc Sep 28 17:25:22 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:22 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc" returned: 0 in 0.272s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-314991369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33c432f-4084-4174-bc6b-cd6708fd1d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc592e6b2814c9abfbd9b3edcdc66d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:21Z,use_quota=True,user_id='3fda53a0744642feb4b46db37ef53b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Creating volume a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:22 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:22 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b 1073741824 Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3906465a-8928-492f-9766-c7c2d6cea4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b389752-69f2-41ae-88b5-05b0e979fbcc', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:22 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562dffe4-aada-495b-af09-15b82e0c5d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Volume volume-1b389752-69f2-41ae-88b5-05b0e979fbcc (1b389752-69f2-41ae-88b5-05b0e979fbcc): created successfully Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562dffe4-aada-495b-af09-15b82e0c5d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (77a9f556-ecd6-4de0-8bb4-139ae267cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Acquiring lock "cinder-ad514028-5d6e-48c7-bff6-9173a1508c1a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9701ae75-acd9-407d-8c96-7283cfa772b8 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "cinder-ad514028-5d6e-48c7-bff6-9173a1508c1a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Acquiring lock "cinder-quobyte-ad514028-5d6e-48c7-bff6-9173a1508c1a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "cinder-quobyte-ad514028-5d6e-48c7-bff6-9173a1508c1a" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b12b8c-e178-4215-ae04-4cab9dd74aef]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:25:23 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b 1073741824" returned: 0 in 0.584s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:23 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.441s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a Sep 28 17:25:23 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd92015a-80b1-4832-8892-5f1a2aba5534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73680b-423f-4c63-a6e2-43d38490d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Volume volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b (a33c432f-4084-4174-bc6b-cd6708fd1d2b): created successfully Sep 28 17:25:23 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73680b-423f-4c63-a6e2-43d38490d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Flow 'volume_create_manager' (b519311b-2041-44ba-aa37-e19f13b99651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ad514028-5d6e-48c7-bff6-9173a1508c1a" returned: 0 in 0.304s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "cinder-quobyte-ad514028-5d6e-48c7-bff6-9173a1508c1a" released by "delete_volume" :: held 0.804s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:23 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-10850e1e-4124-4912-9233-46a2932d07b3 tempest-VolumeDependencyTests-709948211 None] Created volume successfully. Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Created reservations ['1080f991-d1d5-404a-95bb-9e39573b473c', 'cad21f46-7bf7-4098-86be-791e44bfcdd1', '4e998ee1-dc68-45e7-aecf-c9982b51c05a', '45363667-4177-4363-bd12-27c315e929dd'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:23 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-1b389752-69f2-41ae-88b5-05b0e979fbcc-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "cinder-1b389752-69f2-41ae-88b5-05b0e979fbcc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-1b389752-69f2-41ae-88b5-05b0e979fbcc" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-1b389752-69f2-41ae-88b5-05b0e979fbcc" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d227e-48dc-47f9-80e4-d6ccdf3622fa]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.346s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Deleted volume successfully. Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-26bdfe94-b7c2-495b-9c75-8a258104cc33 tempest-TestImageHashVerification-62487597 None] Lock "cinder-ad514028-5d6e-48c7-bff6-9173a1508c1a-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:24 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc Sep 28 17:25:24 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Creating offline snapshot 46ccd4d2-4c5c-45ec-989b-1eea2af938eb of volume a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:24 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc" returned: 0 in 0.571s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52b8042-ea6a-4f03-b619-be40506e5072]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc Sep 28 17:25:24 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:24 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:24 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:25 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1b389752-69f2-41ae-88b5-05b0e979fbcc" returned: 0 in 0.393s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-1b389752-69f2-41ae-88b5-05b0e979fbcc" released by "delete_volume" :: held 1.080s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Created reservations ['b2842a71-95e3-435c-b04e-b36c9355ca9e', 'c7546ce1-9d9b-4452-8e93-8493ae24d7e4', '750bd3c7-c12d-4fcd-8c11-246bfcab37ca', 'dc9ee209-638d-44ca-9232-795b6915bd50'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:25 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.560s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:25 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb 1G Sep 28 17:25:25 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:25 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:25 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:25 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.341s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-06655c28-565e-43a4-96e4-0802c6f2e06e tempest-VolumesGetTest-702939044 None] Lock "cinder-1b389752-69f2-41ae-88b5-05b0e979fbcc-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:25 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb 1G" returned: 0 in 0.604s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:25 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:25 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:26 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.533s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:26 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb is being set with open permissions: ugo+rw Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-bd0da13f-7f62-4765-8957-e8dae6ea5806-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:26 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:26 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "cinder-bd0da13f-7f62-4765-8957-e8dae6ea5806-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-bd0da13f-7f62-4765-8957-e8dae6ea5806" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-bd0da13f-7f62-4765-8957-e8dae6ea5806" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f476c-7071-4de7-af4e-1caa3ba25731]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:26 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 Sep 28 17:25:26 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:26 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.419s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:26 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info Sep 28 17:25:26 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:27 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806" returned: 0 in 0.560s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:27 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806 Sep 28 17:25:27 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:27 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info" returned: 0 in 0.410s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:27 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info is being set with open permissions: ugo+rw Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:27 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info Sep 28 17:25:27 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:27 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd0da13f-7f62-4765-8957-e8dae6ea5806" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-bd0da13f-7f62-4765-8957-e8dae6ea5806" released by "delete_volume" :: held 0.966s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:27 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.info" returned: 0 in 0.321s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Created reservations ['186f6d30-6d5d-44a8-abc8-68c7af32a285', 'edabb8c4-298d-476e-a59d-91fee64e5b53', '391eba6a-4c72-4eb4-b9b3-56f8468497ba', '57ca376c-d62d-47f1-a613-64c931fe0ad5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:27 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fe8f89fa-9a12-4720-a523-7eb5f2dc5cf3 tempest-VolumeDependencyTests-709948211 None] Create snapshot completed successfully Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:27 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:27 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:28 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.316s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3e8153d5-7a9c-4ab1-8371-fadeea07df53 tempest-VolumesGetTest-702939044 None] Lock "cinder-bd0da13f-7f62-4765-8957-e8dae6ea5806-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Flow 'volume_create_manager' (67f18af8-2e5c-44fd-9634-2c0eb53b28b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a79399-5d2c-4f2a-a218-f76ac2b76ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a79399-5d2c-4f2a-a218-f76ac2b76ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1386021472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c00f3ff-ae33-41fb-8ef4-a851c0a714cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bc592e6b2814c9abfbd9b3edcdc66d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46ccd4d2-4c5c-45ec-989b-1eea2af938eb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:28Z,use_quota=True,user_id='3fda53a0744642feb4b46db37ef53b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41a2243-816f-4a11-b99f-d1e519357135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c41a2243-816f-4a11-b99f-d1e519357135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d930df89-09c7-45d6-beac-159293763a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d930df89-09c7-45d6-beac-159293763a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c00f3ff-ae33-41fb-8ef4-a851c0a714cb', 'volume_name': 'volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb', 'volume_size': 1, 'snapshot_id': '46ccd4d2-4c5c-45ec-989b-1eea2af938eb'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3a6ff1-128e-4aa6-9aba-9fa070c3630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3a6ff1-128e-4aa6-9aba-9fa070c3630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac39216e-043f-4c53-a105-295a0369574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:28 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Volume 3c00f3ff-ae33-41fb-8ef4-a851c0a714cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb', 'volume_size': 1, 'snapshot_id': '46ccd4d2-4c5c-45ec-989b-1eea2af938eb'} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Creating volume 3c00f3ff-ae33-41fb-8ef4-a851c0a714cb from snapshot 46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] snapshot: 46ccd4d2-4c5c-45ec-989b-1eea2af938eb, volume: 3c00f3ff-ae33-41fb-8ef4-a851c0a714cb, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad23ad20-9d81-4901-ba63-5593fc35835c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:28 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:28 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:29 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.563s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f078be-84ee-4000-9822-1b6b34f26be5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (178601dc-ad38-4ebf-b679-d4c87183ca01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b039396-cec4-45ed-ab4c-ac8b0d4e87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b039396-cec4-45ed-ab4c-ac8b0d4e87d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1467410892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:29Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa39587-4b9d-4373-8ab2-8264e160c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa39587-4b9d-4373-8ab2-8264e160c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5572ad6a-e52f-489b-8ba0-97ef109d64be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5572ad6a-e52f-489b-8ba0-97ef109d64be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'volume_name': 'volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ccd49e-fb6a-4027-ab58-d0d5f4d562be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ccd49e-fb6a-4027-ab58-d0d5f4d562be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb4dc0f-76c8-4519-9091-a19e1176149c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Volume 268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'volume_size': 1} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:29 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:29 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:29 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.484s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:29 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb Sep 28 17:25:29 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" returned: 0 in 8.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b, size 1024.00 MB, duration 8.39 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:38 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Converted 1024.00 MB image at 122.04 MB/s Sep 28 17:25:38 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb is being set with open permissions: ugo+rw Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:38 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb Sep 28 17:25:38 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" returned: 0 in 0.318s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" released by "_copy_volume_from_snapshot" :: held 9.872s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" released by "_create_volume_from_snapshot" :: held 9.959s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.977s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.124s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1467410892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:29Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Creating volume 268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:38 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:38 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 1073741824 Sep 28 17:25:38 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac39216e-043f-4c53-a105-295a0369574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb', 'volume_size': 1, 'snapshot_id': '46ccd4d2-4c5c-45ec-989b-1eea2af938eb'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97d593-14e0-458d-91a7-a37b7d4184d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:38 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Volume volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb (3c00f3ff-ae33-41fb-8ef4-a851c0a714cb): created successfully Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef97d593-14e0-458d-91a7-a37b7d4184d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Flow 'volume_create_manager' (67f18af8-2e5c-44fd-9634-2c0eb53b28b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-972a344b-84b2-4c26-8e0c-2c7febeaaaf2 tempest-VolumeDependencyTests-709948211 None] Created volume successfully. Sep 28 17:25:39 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 1073741824" returned: 0 in 0.564s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:39 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:25:39 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:39 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.292s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb4dc0f-76c8-4519-9091-a19e1176149c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accbfe4b-576e-479f-b16a-10442acd5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:39 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Volume volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 (268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7): created successfully Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accbfe4b-576e-479f-b16a-10442acd5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (178601dc-ad38-4ebf-b679-d4c87183ca01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-90fb65cb-6ddd-42e1-8eba-7350ebda43d6 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Deleting offline snapshot 46ccd4d2-4c5c-45ec-989b-1eea2af938eb of volume a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] snapshot_file for this snap is: volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ee0ae-dc0d-4f2f-8b9f-21d2fc02136e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:39 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:39 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:40 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.448s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97bdf8-7f75-4d1d-86c0-9389d5511f52]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:40 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:40 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:40 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.643s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:41 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:41 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:41 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.484s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:41 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb Sep 28 17:25:41 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (bd6275f6-8176-484a-952e-ecc1a74a2437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f93b0-fcbe-4ecc-830f-559ddb5b4f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f93b0-fcbe-4ecc-830f-559ddb5b4f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1228179968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ae8486-3ee6-4f30-a845-c7827afd92be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:42Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402b1937-74ef-4133-8c1d-b570e9ace3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (402b1937-74ef-4133-8c1d-b570e9ace3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8afb1e-44fc-44f1-b432-9e54dc6de667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8afb1e-44fc-44f1-b432-9e54dc6de667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '93ae8486-3ee6-4f30-a845-c7827afd92be', 'volume_name': 'volume-93ae8486-3ee6-4f30-a845-c7827afd92be', 'volume_size': 1, 'source_volid': '268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'source_volstatus': 'available'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719e12a6-3f19-414b-b144-ad6fb46acd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719e12a6-3f19-414b-b144-ad6fb46acd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fe68a9-8447-4d14-9420-d6fb4c35751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Volume 93ae8486-3ee6-4f30-a845-c7827afd92be: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-93ae8486-3ee6-4f30-a845-c7827afd92be', 'volume_size': 1, 'source_volid': '268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'source_volstatus': 'available'} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Cloning volume 268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 to volume 93ae8486-3ee6-4f30-a845-c7827afd92be Sep 28 17:25:41 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b.46ccd4d2-4c5c-45ec-989b-1eea2af938eb" returned: 0 in 0.326s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-46ccd4d2-4c5c-45ec-989b-1eea2af938eb" released by "_delete_snapshot" :: held 2.056s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" released by "delete_snapshot" :: held 2.086s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Creating offline snapshot 90657dd6-015f-4c17-9fd1-e8d143d2b9bc of volume 268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cbbb9-ef9f-4b27-9de6-339a6f746ebe]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:41 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Created reservations ['608fecbc-beaf-40b3-93c1-ac7971078308', '4c0c7bcd-f1a5-4164-91a5-2fbd35606d18', 'a2c742ca-65af-4466-a457-2a21c07f6d25', '721bccfb-1499-4a0a-9872-e7027bec4a1d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:42 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:25:42 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Delete snapshot completed successfully. Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6948e4dc-8352-4daa-bfc5-585f04c53bf3 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-46ccd4d2-4c5c-45ec-989b-1eea2af938eb-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (b4b52c35-d198-4334-b957-e965d0ace2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8dc3b1-b12a-4e2e-b561-dac379bc7422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8dc3b1-b12a-4e2e-b561-dac379bc7422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309573107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787175f0-c2a6-4473-aef0-3ca98b98d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:42Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d08cd2-d930-4a6b-865c-f87d50cb79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d08cd2-d930-4a6b-865c-f87d50cb79cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1882f6e-6f09-41f1-81fa-536740c3c019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1882f6e-6f09-41f1-81fa-536740c3c019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787175f0-c2a6-4473-aef0-3ca98b98d053', 'volume_name': 'volume-787175f0-c2a6-4473-aef0-3ca98b98d053', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2426442d-3978-4098-b676-b7a54999b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2426442d-3978-4098-b676-b7a54999b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3ee546-610f-46b4-968d-81233e5f8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Volume 787175f0-c2a6-4473-aef0-3ca98b98d053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787175f0-c2a6-4473-aef0-3ca98b98d053', 'volume_size': 1} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.538s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:42 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc 1G Sep 28 17:25:42 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (ff102a5b-f135-4e52-a17d-74be8c2d7a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b386f-927f-46a1-b86c-3cf81cda2d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b386f-927f-46a1-b86c-3cf81cda2d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104500686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d9a3c2-db4f-4973-a819-b25b66c20671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:43Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b5eab2-7d00-403c-a48e-cdd1fd015ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b5eab2-7d00-403c-a48e-cdd1fd015ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e206d7-f794-429e-911b-1540d37be265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e206d7-f794-429e-911b-1540d37be265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d9a3c2-db4f-4973-a819-b25b66c20671', 'volume_name': 'volume-06d9a3c2-db4f-4973-a819-b25b66c20671', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e888ef8-1f47-4f6b-b6c5-5f2df5ce42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e888ef8-1f47-4f6b-b6c5-5f2df5ce42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32c542-0522-4b31-a59c-1d042fa6422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:42 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Volume 06d9a3c2-db4f-4973-a819-b25b66c20671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d9a3c2-db4f-4973-a819-b25b66c20671', 'volume_size': 1} Sep 28 17:25:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:43 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc 1G" returned: 0 in 0.565s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-a33c432f-4084-4174-bc6b-cd6708fd1d2b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:43 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-a33c432f-4084-4174-bc6b-cd6708fd1d2b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc60aa-7abb-49ea-a475-861c0eb3017a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:43 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:43 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (4258e528-fa7c-42c7-9467-e21c988486bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7dfa27-a309-405c-b881-34523b57437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7dfa27-a309-405c-b881-34523b57437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910734693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:43Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c266225-cb9f-4788-a06f-3bc09c11142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c266225-cb9f-4788-a06f-3bc09c11142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e129cf-b958-44a2-97bd-cce8bc308540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e129cf-b958-44a2-97bd-cce8bc308540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb', 'volume_name': 'volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc843a2-a9a4-4ee6-82d2-561d7c5f10a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc843a2-a9a4-4ee6-82d2-561d7c5f10a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4457a568-d724-4719-97f4-73471ae65525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Volume e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb', 'volume_size': 1} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.460s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc is being set with open permissions: ugo+rw Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:43 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.556s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.308s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:43 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b Sep 28 17:25:43 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:43 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info Sep 28 17:25:43 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (4e7ba381-a251-447b-bd45-bad7a3f45296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a83c787-b165-4845-9a71-26acfc50e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a83c787-b165-4845-9a71-26acfc50e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306024722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d86ce05-1b91-4d2e-8170-47eefc7cb863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:44Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4364fac-130b-48ac-acee-17c6f2a1e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4364fac-130b-48ac-acee-17c6f2a1e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6bb79-eed1-4305-a074-bcab73ef38a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c6bb79-eed1-4305-a074-bcab73ef38a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d86ce05-1b91-4d2e-8170-47eefc7cb863', 'volume_name': 'volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c50fb-4c57-4881-95f0-8ea9ab65550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9c50fb-4c57-4881-95f0-8ea9ab65550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e4b730-68c7-405c-b2dd-0535417addef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Volume 2d86ce05-1b91-4d2e-8170-47eefc7cb863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863', 'volume_size': 1} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a33c432f-4084-4174-bc6b-cd6708fd1d2b" returned: 0 in 0.463s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-a33c432f-4084-4174-bc6b-cd6708fd1d2b" released by "delete_volume" :: held 1.114s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:44 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info is being set with open permissions: ugo+rw Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Created reservations ['57a70a0f-7941-4fb2-aab3-65ce83643004', 'efbca5ba-6cb8-47d3-8571-cdc623235988', '34459f96-de51-4f3e-947f-74ce2258ed29', '3cbd4b30-24da-446d-a291-e234bcd63c55'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:44 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info Sep 28 17:25:44 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (11ea5743-6fd5-403f-8aa5-9cc90e26f065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd40ae-aa0a-4aa1-8493-603f5d76c785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd40ae-aa0a-4aa1-8493-603f5d76c785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141854034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febdb0e3-ef2b-4373-9049-870cd61e3a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:44Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b57aec-ce76-4b5d-89d8-eff822e1725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b57aec-ce76-4b5d-89d8-eff822e1725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06719c5-bb49-4afe-ab86-828f522f009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06719c5-bb49-4afe-ab86-828f522f009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febdb0e3-ef2b-4373-9049-870cd61e3a90', 'volume_name': 'volume-febdb0e3-ef2b-4373-9049-870cd61e3a90', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8340eeeb-4cf0-474a-bc23-ae74e8cb4060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8340eeeb-4cf0-474a-bc23-ae74e8cb4060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10026a00-5fa3-407e-93c5-ac0ba6cc76a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Volume febdb0e3-ef2b-4373-9049-870cd61e3a90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febdb0e3-ef2b-4373-9049-870cd61e3a90', 'volume_size': 1} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:44 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.info" returned: 0 in 0.305s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] snapshot: 90657dd6-015f-4c17-9fd1-e8d143d2b9bc, volume: 93ae8486-3ee6-4f30-a845-c7827afd92be, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e450594-9688-4b6b-9889-e2d2fc47d688]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.286s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:44 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:44 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Deleted volume successfully. Sep 28 17:25:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c26a64fa-80a7-4fd7-9624-dd0ee53faa97 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-a33c432f-4084-4174-bc6b-cd6708fd1d2b-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:45 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.420s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b606bc-887b-4baf-9e2a-1c86ec0617f4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:25:45 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[90302df5-bc97-48b9-8df5-a84c1df3f4db]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be Sep 28 17:25:45 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb Sep 28 17:25:45 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:45 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" returned: 0 in 0.420s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:45 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb Sep 28 17:25:45 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:46 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" returned: 0 in 0.319s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-quobyte-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb" released by "delete_volume" :: held 0.806s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Created reservations ['deb25859-5a2c-4936-bbc1-f0be506c1c5e', 'fb341956-1d78-415e-b3b8-6a28f2256ce0', '6137afe6-6504-4523-8547-fef7d0bdd94d', '1ca2f72c-e625-47cc-a664-65b059e0ea94'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:46 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:25:46 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:47 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.488s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Deleted volume successfully. Sep 28 17:25:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-753ef3d4-328e-499a-afc6-444993c3ba60 tempest-VolumeDependencyTests-709948211 None] Lock "cinder-3c00f3ff-ae33-41fb-8ef4-a851c0a714cb-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Flow 'volume_create_manager' (1828758d-6dcb-436b-8170-23541873094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0060639d-5997-4ebd-aee9-e0137a6d3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0060639d-5997-4ebd-aee9-e0137a6d3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b525115f-1b31-4afe-96e8-db4f01540057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02efac7876a8494eb8bae55faaa57e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:53Z,use_quota=True,user_id='335ff7cc83954c7c9fd1b86ff960c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc29126-573d-41c8-9573-69795774be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc29126-573d-41c8-9573-69795774be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270e80fe-0dff-48c3-92f4-e7046a1bdbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (270e80fe-0dff-48c3-92f4-e7046a1bdbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b525115f-1b31-4afe-96e8-db4f01540057', 'volume_name': 'volume-b525115f-1b31-4afe-96e8-db4f01540057', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de963be7-251e-4ef6-8443-fe02e8b9e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de963be7-251e-4ef6-8443-fe02e8b9e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571eba1e-0430-4be6-843c-14a7c568ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Volume b525115f-1b31-4afe-96e8-db4f01540057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b525115f-1b31-4afe-96e8-db4f01540057', 'volume_size': 1} Sep 28 17:25:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:53 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be" returned: 0 in 7.864s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:53 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Converted 1024.00 MB image at 130.19 MB/s Sep 28 17:25:53 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be is being set with open permissions: ugo+rw Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:53 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be Sep 28 17:25:53 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:53 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be" returned: 0 in 0.281s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" released by "_copy_volume_from_snapshot" :: held 9.118s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-90657dd6-015f-4c17-9fd1-e8d143d2b9bc" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-90657dd6-015f-4c17-9fd1-e8d143d2b9bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Deleting offline snapshot 90657dd6-015f-4c17-9fd1-e8d143d2b9bc of volume 268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] snapshot_file for this snap is: volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a04e6-0a7a-4679-ae1f-91ab463a9aea]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:53 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:53 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.420s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02bbb6-0cef-47c8-9187-05341cea9351]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:25:54 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:54 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:54 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:54 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:55 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:55 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc Sep 28 17:25:55 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:55 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7.90657dd6-015f-4c17-9fd1-e8d143d2b9bc" returned: 0 in 0.256s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-90657dd6-015f-4c17-9fd1-e8d143d2b9bc" released by "_delete_snapshot" :: held 1.739s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.789s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.134s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309573107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787175f0-c2a6-4473-aef0-3ca98b98d053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:42Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Creating volume 787175f0-c2a6-4473-aef0-3ca98b98d053 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:55 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:55 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 1073741824 Sep 28 17:25:55 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41fe68a9-8447-4d14-9420-d6fb4c35751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ae8486-3ee6-4f30-a845-c7827afd92be', 'volume_size': 1, 'source_volid': '268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7', 'source_volstatus': 'available'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac639b9-c64e-4062-bc54-af3f9e96b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:55 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Volume volume-93ae8486-3ee6-4f30-a845-c7827afd92be (93ae8486-3ee6-4f30-a845-c7827afd92be): created successfully Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac639b9-c64e-4062-bc54-af3f9e96b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:55 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (bd6275f6-8176-484a-952e-ecc1a74a2437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-27722c2c-8e77-4f31-b37d-67c83d20a787 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:25:56 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 1073741824" returned: 0 in 0.582s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:56 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 Sep 28 17:25:56 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:56 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.763s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104500686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d9a3c2-db4f-4973-a819-b25b66c20671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:43Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Creating volume 06d9a3c2-db4f-4973-a819-b25b66c20671 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:56 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:56 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 1073741824 Sep 28 17:25:56 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3ee546-610f-46b4-968d-81233e5f8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787175f0-c2a6-4473-aef0-3ca98b98d053', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfb24a7-42d0-4be4-863b-10aa2ba1e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Volume volume-787175f0-c2a6-4473-aef0-3ca98b98d053 (787175f0-c2a6-4473-aef0-3ca98b98d053): created successfully Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfb24a7-42d0-4be4-863b-10aa2ba1e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (b4b52c35-d198-4334-b957-e965d0ace2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3861e57b-77b2-48cc-801b-364da654efee tempest-CreateVolumesFromImageTest-1771149178 None] Created volume successfully. Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (e9b579c7-8d44-42e6-99bb-3b8fecda694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e490db-3a6b-4b4b-94e5-c0cc414c7f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e490db-3a6b-4b4b-94e5-c0cc414c7f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-908493947',display_name='tempest-VolumesGetTest-Volume-1567422387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600cd54b-f16e-456a-8f96-72edb8ee4173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:57Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b34d32-7e63-4699-96f9-9e717ff534c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b34d32-7e63-4699-96f9-9e717ff534c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35474b4f-1719-4b9a-b151-09881fd43f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35474b4f-1719-4b9a-b151-09881fd43f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600cd54b-f16e-456a-8f96-72edb8ee4173', 'volume_name': 'volume-600cd54b-f16e-456a-8f96-72edb8ee4173', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbff3d37-4996-4df5-b119-27ad521ccc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbff3d37-4996-4df5-b119-27ad521ccc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d736a6c-ef85-422d-8792-1ed1652df487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Volume 600cd54b-f16e-456a-8f96-72edb8ee4173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600cd54b-f16e-456a-8f96-72edb8ee4173', 'volume_size': 1} Sep 28 17:25:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:57 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 1073741824" returned: 0 in 0.617s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:57 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 Sep 28 17:25:57 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:57 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.137s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-910734693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:43Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Creating volume e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:57 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:57 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb 1073741824 Sep 28 17:25:57 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd32c542-0522-4b31-a59c-1d042fa6422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d9a3c2-db4f-4973-a819-b25b66c20671', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcbe9c-2db1-4b38-839a-7da2403889e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Volume volume-06d9a3c2-db4f-4973-a819-b25b66c20671 (06d9a3c2-db4f-4973-a819-b25b66c20671): created successfully Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dcbe9c-2db1-4b38-839a-7da2403889e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (ff102a5b-f135-4e52-a17d-74be8c2d7a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ac8134fe-38dd-4c98-b37b-d0bde539588f tempest-CreateVolumesFromImageTest-1771149178 None] Created volume successfully. Sep 28 17:25:58 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb 1073741824" returned: 0 in 0.554s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb Sep 28 17:25:58 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" returned: 0 in 0.306s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.527s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306024722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d86ce05-1b91-4d2e-8170-47eefc7cb863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:44Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Creating volume 2d86ce05-1b91-4d2e-8170-47eefc7cb863 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:58 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4457a568-d724-4719-97f4-73471ae65525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 1073741824 Sep 28 17:25:58 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3349b7-98e4-4c3f-8be3-2178db2624c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Volume volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb (e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb): created successfully Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3349b7-98e4-4c3f-8be3-2178db2624c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (4258e528-fa7c-42c7-9467-e21c988486bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e17b28f6-1ab6-46c1-848c-80c318dc1bb5 tempest-CreateVolumesFromImageTest-1771149178 None] Created volume successfully. Sep 28 17:25:59 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 1073741824" returned: 0 in 0.635s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:59 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 Sep 28 17:25:59 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:59 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863" returned: 0 in 0.313s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.046s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-141854034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febdb0e3-ef2b-4373-9049-870cd61e3a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b7d38e895b42d9ab232795d0b3b4c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:44Z,use_quota=True,user_id='01cc7596dc354e4e9f37e688c64ac83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Creating volume febdb0e3-ef2b-4373-9049-870cd61e3a90 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:59 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:59 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 1073741824 Sep 28 17:25:59 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e4b730-68c7-405c-b2dd-0535417addef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3a8e0a-a613-411e-b24b-bba321915be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Volume volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 (2d86ce05-1b91-4d2e-8170-47eefc7cb863): created successfully Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3a8e0a-a613-411e-b24b-bba321915be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (4e7ba381-a251-447b-bd45-bad7a3f45296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2983d9cb-f0c9-4041-a04b-c10095fbb410 tempest-CreateVolumesFromImageTest-1771149178 None] Created volume successfully. Sep 28 17:26:00 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 1073741824" returned: 0 in 0.490s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 Sep 28 17:26:00 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:00 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90" returned: 0 in 0.288s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.409s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b525115f-1b31-4afe-96e8-db4f01540057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02efac7876a8494eb8bae55faaa57e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:53Z,use_quota=True,user_id='335ff7cc83954c7c9fd1b86ff960c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Creating volume b525115f-1b31-4afe-96e8-db4f01540057 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:00 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10026a00-5fa3-407e-93c5-ac0ba6cc76a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febdb0e3-ef2b-4373-9049-870cd61e3a90', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:00 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 1073741824 Sep 28 17:26:00 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc9a3b3-7805-415a-ac9e-3ae3dfc5a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:00 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Volume volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 (febdb0e3-ef2b-4373-9049-870cd61e3a90): created successfully Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc9a3b3-7805-415a-ac9e-3ae3dfc5a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Flow 'volume_create_manager' (11ea5743-6fd5-403f-8aa5-9cc90e26f065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ec2da46c-2230-41ca-b8cf-02ea7267ab90 tempest-CreateVolumesFromImageTest-1771149178 None] Created volume successfully. Sep 28 17:26:00 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 1073741824" returned: 0 in 0.483s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 Sep 28 17:26:00 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057" returned: 0 in 0.320s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.300s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-908493947',display_name='tempest-VolumesGetTest-Volume-1567422387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600cd54b-f16e-456a-8f96-72edb8ee4173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:57Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Creating volume 600cd54b-f16e-456a-8f96-72edb8ee4173 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:01 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571eba1e-0430-4be6-843c-14a7c568ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b525115f-1b31-4afe-96e8-db4f01540057', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:01 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 1073741824 Sep 28 17:26:01 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addd18e4-7a87-4a9e-b1c5-28c037866810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Volume volume-b525115f-1b31-4afe-96e8-db4f01540057 (b525115f-1b31-4afe-96e8-db4f01540057): created successfully Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addd18e4-7a87-4a9e-b1c5-28c037866810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Flow 'volume_create_manager' (1828758d-6dcb-436b-8170-23541873094b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a141dd12-7020-4785-920c-61008c088d97 tempest-CinderUnicodeTest-1968543937 None] Created volume successfully. Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-febdb0e3-ef2b-4373-9049-870cd61e3a90-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-febdb0e3-ef2b-4373-9049-870cd61e3a90-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-quobyte-febdb0e3-ef2b-4373-9049-870cd61e3a90" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-febdb0e3-ef2b-4373-9049-870cd61e3a90" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc1e8b-2b70-4d3a-9742-a2dcca16f262]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 Sep 28 17:26:01 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 1073741824" returned: 0 in 0.553s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 Sep 28 17:26:01 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90" returned: 0 in 0.513s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90 Sep 28 17:26:02 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d736a6c-ef85-422d-8792-1ed1652df487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600cd54b-f16e-456a-8f96-72edb8ee4173', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b05338-b627-44a3-a07d-ee16473cdecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Volume volume-600cd54b-f16e-456a-8f96-72edb8ee4173 (600cd54b-f16e-456a-8f96-72edb8ee4173): created successfully Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b05338-b627-44a3-a07d-ee16473cdecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (e9b579c7-8d44-42e6-99bb-3b8fecda694f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b36c2de4-5ccf-40c8-8139-e2c6422ad3c9 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:26:02 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-febdb0e3-ef2b-4373-9049-870cd61e3a90" returned: 0 in 0.288s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-febdb0e3-ef2b-4373-9049-870cd61e3a90" released by "delete_volume" :: held 0.857s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Created reservations ['87ee5b25-8ced-427f-a6ea-aea5ade152e7', '250f2f33-3396-444c-8f7f-661b0845d9b4', '9228a9b1-22de-4a1b-bf11-b2093e86a9f5', '15880fd7-2a06-42a0-ba03-3feea9bf4546'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:02 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-2d86ce05-1b91-4d2e-8170-47eefc7cb863-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-2d86ce05-1b91-4d2e-8170-47eefc7cb863-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-quobyte-2d86ce05-1b91-4d2e-8170-47eefc7cb863" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-2d86ce05-1b91-4d2e-8170-47eefc7cb863" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:02 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.329s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ed9d69-daf5-40f8-b562-971c027b7ce5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Deleted volume successfully. Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-7e34a5a1-fd6a-4457-adcf-ca26fc68c766 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-febdb0e3-ef2b-4373-9049-870cd61e3a90-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:03 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 Sep 28 17:26:03 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Flow 'volume_create_manager' (4c3ec630-6c9f-4922-b853-256c20c6a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea31f83-005f-4c75-8256-a48f9ded25cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea31f83-005f-4c75-8256-a48f9ded25cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1069571389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156f43a-f122-43dc-8712-947859a52897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02efac7876a8494eb8bae55faaa57e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='335ff7cc83954c7c9fd1b86ff960c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca3106-5bac-46e0-a6f6-7ef131397e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ca3106-5bac-46e0-a6f6-7ef131397e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad43a62-7dda-4c7f-88cc-4af18f7cc299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad43a62-7dda-4c7f-88cc-4af18f7cc299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1156f43a-f122-43dc-8712-947859a52897', 'volume_name': 'volume-1156f43a-f122-43dc-8712-947859a52897', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ac7496-dcbe-4740-81f8-4ff37ef45643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41ac7496-dcbe-4740-81f8-4ff37ef45643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7661a44-7923-42a8-a946-7734b02090cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Volume 1156f43a-f122-43dc-8712-947859a52897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1156f43a-f122-43dc-8712-947859a52897', 'volume_size': 1} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1069571389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156f43a-f122-43dc-8712-947859a52897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02efac7876a8494eb8bae55faaa57e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='335ff7cc83954c7c9fd1b86ff960c810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Creating volume 1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:03 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 1073741824 Sep 28 17:26:03 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-600cd54b-f16e-456a-8f96-72edb8ee4173-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "cinder-600cd54b-f16e-456a-8f96-72edb8ee4173-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:03 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863 Sep 28 17:26:03 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-600cd54b-f16e-456a-8f96-72edb8ee4173" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-600cd54b-f16e-456a-8f96-72edb8ee4173" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b466e5-ff9d-4140-9c80-e897145c37e4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 Sep 28 17:26:03 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 1073741824" returned: 0 in 0.523s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2d86ce05-1b91-4d2e-8170-47eefc7cb863" returned: 0 in 0.362s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-2d86ce05-1b91-4d2e-8170-47eefc7cb863" released by "delete_volume" :: held 0.926s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 Sep 28 17:26:03 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Created reservations ['7dae6534-8df2-46d8-a62d-35bdc2eeadc7', '42cc9e0e-b082-40b2-929e-90f579a009a8', 'b291072e-27a5-42b5-b070-9f9eb58872b2', '917f1d18-ed77-4d44-b717-a03778503e84'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:04 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173" returned: 0 in 0.451s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:04 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173 Sep 28 17:26:04 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:04 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897" returned: 0 in 0.301s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7661a44-7923-42a8-a946-7734b02090cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1156f43a-f122-43dc-8712-947859a52897', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70890d6e-9bed-49a0-92ff-397ca2543343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Volume volume-1156f43a-f122-43dc-8712-947859a52897 (1156f43a-f122-43dc-8712-947859a52897): created successfully Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70890d6e-9bed-49a0-92ff-397ca2543343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Flow 'volume_create_manager' (4c3ec630-6c9f-4922-b853-256c20c6a148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4e27986c-308b-4d01-8fe5-4bf21bc0ac72 tempest-CinderUnicodeTest-1968543937 None] Created volume successfully. Sep 28 17:26:04 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-600cd54b-f16e-456a-8f96-72edb8ee4173" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-600cd54b-f16e-456a-8f96-72edb8ee4173" released by "delete_volume" :: held 0.788s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.281s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Deleted volume successfully. Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65480af8-87fe-4028-9df9-3fe1cb3a5665 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-2d86ce05-1b91-4d2e-8170-47eefc7cb863-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Created reservations ['d599643a-00ec-4221-b501-d7ab5ed07d73', 'ac34d181-2f77-45da-83a4-878a9287a4f8', '18105d7b-2013-4ed1-a3aa-4ddd339bbad7', '2a77d213-9460-47b4-9c01-00b79ce602f9'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:04 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-93ae8486-3ee6-4f30-a845-c7827afd92be-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "cinder-93ae8486-3ee6-4f30-a845-c7827afd92be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:04 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.272s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d38af6dd-4196-47c0-ae7d-0cb0c0a00d80 tempest-VolumesGetTest-702939044 None] Lock "cinder-600cd54b-f16e-456a-8f96-72edb8ee4173-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fb31e-73fd-4917-8b01-5d77c864291d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be Sep 28 17:26:04 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-quobyte-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6788b9f-aa00-42f2-9a85-2c3a4a30a8e0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be Sep 28 17:26:05 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb Sep 28 17:26:05 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Creating offline snapshot 8df52819-0a78-48c9-9fae-10339d9a29de of volume 1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:05 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-93ae8486-3ee6-4f30-a845-c7827afd92be" returned: 0 in 0.308s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2c1084-dd5f-491d-a9be-33f7978f6db3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-93ae8486-3ee6-4f30-a845-c7827afd92be" released by "delete_volume" :: held 0.817s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:05 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Created reservations ['bc45c64d-62f7-4803-ba84-8a7a46fe94a7', '3d136fae-4a21-4b92-bc50-ecde37f9fcde', '3c707e76-d582-4fe2-88e4-d54a45935478', '1da5b838-371c-4560-b691-d8c73e6cf5e8'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:05 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb Sep 28 17:26:05 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 Sep 28 17:26:05 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:05 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" returned: 0 in 0.354s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "cinder-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb" released by "delete_volume" :: held 0.903s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.344s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:26:06 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897" returned: 0 in 0.566s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:06 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de 1G Sep 28 17:26:06 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-65683d74-1278-4fde-aed6-845b6844a057 tempest-VolumesGetTest-702939044 None] Lock "cinder-93ae8486-3ee6-4f30-a845-c7827afd92be-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[368aea4a-9fe2-44a7-8c62-6b63cec99eaa]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Created reservations ['3578ce8a-4a1a-4fc9-93b8-0b6731acc2a2', '8f5d8dd8-d48b-4269-9ec5-f255ec107d30', 'e2a70bdb-786d-43ce-a63b-60f8d7c5f082', 'c085a0d3-2d69-43db-9ec4-fa00f33b53ba'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:26:06 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:06 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de 1G" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156f43a-f122-43dc-8712-947859a52897 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.292s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Deleted volume successfully. Sep 28 17:26:06 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156f43a-f122-43dc-8712-947859a52897 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de Sep 28 17:26:06 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-015d0cf3-2017-454b-9bef-bd2776db8741 tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-e6f2c8d2-5b3e-46b5-a9e2-3eb925e031eb-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7 Sep 28 17:26:06 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156f43a-f122-43dc-8712-947859a52897 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de" returned: 0 in 0.327s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de is being set with open permissions: ugo+rw Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" returned: 0 in 0.273s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de Sep 28 17:26:06 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7" released by "delete_volume" :: held 0.841s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Created reservations ['ce93bb73-5a10-42f0-be06-07bb8f53727b', '423cfe97-9457-48e0-9d6f-fa57a1df7003', 'ee2fedf8-2e04-4aaf-a6f4-7317adcb8487', '22f2675d-c9e3-44f1-bea9-5bcfb6b59859'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:07 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info Sep 28 17:26:07 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-06d9a3c2-db4f-4973-a819-b25b66c20671-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-06d9a3c2-db4f-4973-a819-b25b66c20671-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.301s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-quobyte-06d9a3c2-db4f-4973-a819-b25b66c20671" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-06d9a3c2-db4f-4973-a819-b25b66c20671" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-bb5f2476-f89f-416e-a405-db9897ab6d6b tempest-VolumesGetTest-702939044 None] Lock "cinder-268cd83e-fe70-4eb6-85f7-ef94c3e1a6e7-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a92c51-b5c3-4425-9b31-f6941ea622a9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:07 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info" returned: 0 in 0.359s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info is being set with open permissions: ugo+rw Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 Sep 28 17:26:07 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info Sep 28 17:26:07 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:07 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.info" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-73b41c7d-705c-4755-81ac-1bde4779d685 tempest-CinderUnicodeTest-1968543937 None] Create snapshot completed successfully Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671" returned: 0 in 0.481s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671 Sep 28 17:26:08 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-06d9a3c2-db4f-4973-a819-b25b66c20671" returned: 0 in 0.308s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-06d9a3c2-db4f-4973-a819-b25b66c20671" released by "delete_volume" :: held 0.846s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Created reservations ['b15eb53f-9db4-412b-8b82-7a6bb20414c9', '8a92ae0c-f625-4bab-b6de-d7756c5b5981', 'e9f8fc19-0001-413b-b03d-70e05614a9d4', 'fc7386f1-f29c-4cee-812e-94cbf562f1ea'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:08 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-787175f0-c2a6-4473-aef0-3ca98b98d053-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-787175f0-c2a6-4473-aef0-3ca98b98d053-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "cinder-quobyte-787175f0-c2a6-4473-aef0-3ca98b98d053" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-787175f0-c2a6-4473-aef0-3ca98b98d053" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1049b4e-645a-4563-8583-160292777e4d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.358s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-8df52819-0a78-48c9-9fae-10339d9a29de-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Deleted volume successfully. Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-8df52819-0a78-48c9-9fae-10339d9a29de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8fea4792-c736-4be0-baf5-7ee07f1c397b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-06d9a3c2-db4f-4973-a819-b25b66c20671-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:08 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 Sep 28 17:26:08 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-quobyte-8df52819-0a78-48c9-9fae-10339d9a29de" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-8df52819-0a78-48c9-9fae-10339d9a29de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Deleting offline snapshot 8df52819-0a78-48c9-9fae-10339d9a29de of volume 1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] snapshot_file for this snap is: volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9425f60c-cda8-49db-a6c5-3e842699638b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (cd84bc66-c800-4957-b453-2a51d90246a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e024737-6767-4a30-a249-df5a02b6370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e024737-6767-4a30-a249-df5a02b6370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1336723331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4297bf12-18a4-41b9-90da-dde241fb522c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:09Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bae51a-70bb-499d-9cb4-2c56aa7d707a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39bae51a-70bb-499d-9cb4-2c56aa7d707a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64bcef7-44af-42e2-8447-e585c1129e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:26:09 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de Sep 28 17:26:09 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053" returned: 0 in 0.507s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053 Sep 28 17:26:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1156f43a-f122-43dc-8712-947859a52897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be318d17-3866-462e-b6a0-8f538a6dd046]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64bcef7-44af-42e2-8447-e585c1129e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4297bf12-18a4-41b9-90da-dde241fb522c', 'volume_name': 'volume-4297bf12-18a4-41b9-90da-dde241fb522c', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a290da-642d-47dd-bc2a-8db0420bae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a290da-642d-47dd-bc2a-8db0420bae8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3df816-5da3-434d-94cd-d355e955363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Volume 4297bf12-18a4-41b9-90da-dde241fb522c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4297bf12-18a4-41b9-90da-dde241fb522c', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Trying to clone 4297bf12-18a4-41b9-90da-dde241fb522c from image fa438d18-3930-42ab-a121-0871daf80309 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:26:09 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-787175f0-c2a6-4473-aef0-3ca98b98d053" returned: 0 in 0.339s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 Sep 28 17:26:09 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-quobyte-787175f0-c2a6-4473-aef0-3ca98b98d053" released by "delete_volume" :: held 0.920s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Created reservations ['7330bbed-1d1a-4bfd-ae3f-8b18402e73c7', '43f1e06c-5fab-48cb-9126-544c767035c0', '3018cdaa-5661-4907-9ae5-251786e5cfd1', '65598353-2fbd-4bf8-a1cf-5b6d4fd3a2a3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:09 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897" returned: 0 in 0.528s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de Sep 28 17:26:10 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:26:10 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320e3f9-29e1-4265-ad45-54493a654642]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.317s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Deleted volume successfully. Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8cd8a6b7-6beb-4d54-88e7-70e6e75fc71b tempest-CreateVolumesFromImageTest-1771149178 None] Lock "cinder-787175f0-c2a6-4473-aef0-3ca98b98d053-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD Sep 28 17:26:10 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de" returned: 0 in 0.366s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de Sep 28 17:26:10 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 is fetched for user 3634c7f208ae45fd86ef5bd1bbedcac3. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e1dfd-9890-48a0-98f1-57a74c4ebe28]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897.8df52819-0a78-48c9-9fae-10339d9a29de" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD Sep 28 17:26:10 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-8df52819-0a78-48c9-9fae-10339d9a29de" released by "_delete_snapshot" :: held 1.752s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" released by "delete_snapshot" :: held 1.782s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Created reservations ['b5244155-5b2d-49ad-98dc-290d8648226b', '138f2328-53cc-4087-8a83-2d1d6d097b0c', '5195a7fc-fa0c-4f02-b60f-40a4f98dc8cf', 'c9068c6a-4c53-4123-9670-eb3f73a1c383'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:10 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Delete snapshot completed successfully. Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-162cc727-af87-4663-99e3-e57123d4dd3e tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-8df52819-0a78-48c9-9fae-10339d9a29de-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1336723331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4297bf12-18a4-41b9-90da-dde241fb522c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:09Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Creating volume 4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:10 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1073741824 Sep 28 17:26:11 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-1156f43a-f122-43dc-8712-947859a52897-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-1156f43a-f122-43dc-8712-947859a52897-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4cb27-f5f1-43b8-8ae2-297e5ea98eb7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 Sep 28 17:26:11 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1073741824" returned: 0 in 0.604s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c Sep 28 17:26:11 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897" returned: 0 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897 Sep 28 17:26:11 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c" returned: 0 in 0.307s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:11 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Attempting download of fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 4297bf12-18a4-41b9-90da-dde241fb522c. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[11474ad8-8348-4795-baef-f4a4ac4a1105]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-1156f43a-f122-43dc-8712-947859a52897" returned: 0 in 0.440s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-1156f43a-f122-43dc-8712-947859a52897" released by "delete_volume" :: held 1.030s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:12 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=111,cinder:UPDATE=164,cinder:INSERT=41,cinder:DELETE=19 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Created reservations ['48bf47a5-a583-4159-b9f7-af4d4c60ef4e', '3770c8be-b5f0-4698-aec4-7f82e7c0dad2', '3ace6161-1c33-4747-9bd7-035f27fd792b', 'f3b2be13-e24f-4fbf-ad06-4925cdf7d70b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:12 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx Sep 28 17:26:12 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.314s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Deleted volume successfully. Sep 28 17:26:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d69ef234-0961-4ad6-92a2-d6a2c29bf294 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-1156f43a-f122-43dc-8712-947859a52897-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx" returned: 1 in 0.437s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa438d18-3930-42ab-a121-0871daf80309_a56drqrx' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b3fad3-ec24-4e2f-bf33-471197d8b749]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD Sep 28 17:26:13 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-b525115f-1b31-4afe-96e8-db4f01540057-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:13 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] fa438d18-3930-42ab-a121-0871daf80309 was qcow2, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c Sep 28 17:26:13 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-b525115f-1b31-4afe-96e8-db4f01540057-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=130,cinder:UPDATE=171,cinder:INSERT=42,cinder:DELETE=9 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "cinder-quobyte-b525115f-1b31-4afe-96e8-db4f01540057" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-b525115f-1b31-4afe-96e8-db4f01540057" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19228b1-c0b0-4852-bd0e-4591b65b28fd]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 Sep 28 17:26:13 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:14 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057" returned: 0 in 0.507s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:14 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057 Sep 28 17:26:14 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:14 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b525115f-1b31-4afe-96e8-db4f01540057" returned: 0 in 0.377s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-quobyte-b525115f-1b31-4afe-96e8-db4f01540057" released by "delete_volume" :: held 0.944s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Created reservations ['29fea613-c650-46fe-913d-34ac8ff62b15', '19c8758f-f83d-4449-a093-3a6e89f180e9', '37c0a24e-932f-4fdf-9181-98a0e40fe285', '811e95cb-59c7-4ac5-9f05-abb32419f367'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:14 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:14 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.349s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:15 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Deleted volume successfully. Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e23c3f57-455a-40dc-9369-37b1b1d4f4e9 tempest-CinderUnicodeTest-1968543937 None] Lock "cinder-b525115f-1b31-4afe-96e8-db4f01540057-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:15 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Flow 'volume_create_manager' (599cfcf2-c9ac-4102-9ca3-8dd312825f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ec4022-f3dd-4e42-9ad4-9d495c72e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c" returned: 0 in 2.510s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa438d18-3930-42ab-a121-0871daf80309_t2vwy74mdevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:15 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Converted 112.00 MB image at 44.58 MB/s Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1G Sep 28 17:26:15 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ec4022-f3dd-4e42-9ad4-9d495c72e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176658403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf5e9d0-a6bf-4020-95ba-12357ad47beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e88fd9259a4bcc914fbf6cdea953e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:16Z,use_quota=True,user_id='f7f6ec48334e4e5999fca89f36968c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252f80b-7204-4f5c-9b46-909103379ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6252f80b-7204-4f5c-9b46-909103379ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f671dfb8-5b4b-43aa-9fa1-a069bb64b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f671dfb8-5b4b-43aa-9fa1-a069bb64b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf5e9d0-a6bf-4020-95ba-12357ad47beb', 'volume_name': 'volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75497792-3d86-4ac9-9198-64cda3560357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75497792-3d86-4ac9-9198-64cda3560357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec569aa6-c653-455a-b852-4bb0a77f06c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Volume ccf5e9d0-a6bf-4020-95ba-12357ad47beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb', 'volume_size': 1} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1176658403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf5e9d0-a6bf-4020-95ba-12357ad47beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e88fd9259a4bcc914fbf6cdea953e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:16Z,use_quota=True,user_id='f7f6ec48334e4e5999fca89f36968c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Creating volume ccf5e9d0-a6bf-4020-95ba-12357ad47beb {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:16 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb 1073741824 Sep 28 17:26:16 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c 1G" returned: 0 in 0.398s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Downloaded image fa438d18-3930-42ab-a121-0871daf80309 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}])) to volume 4297bf12-18a4-41b9-90da-dde241fb522c successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Temporary image fa438d18-3930-42ab-a121-0871daf80309 for user 3634c7f208ae45fd86ef5bd1bbedcac3 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Marking volume 4297bf12-18a4-41b9-90da-dde241fb522c as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Copying metadata from image fa438d18-3930-42ab-a121-0871daf80309 to 4297bf12-18a4-41b9-90da-dde241fb522c. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Creating volume glance metadata for volume 4297bf12-18a4-41b9-90da-dde241fb522c backed by image fa438d18-3930-42ab-a121-0871daf80309 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3df816-5da3-434d-94cd-d355e955363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4297bf12-18a4-41b9-90da-dde241fb522c', 'volume_size': 1, 'image_id': 'fa438d18-3930-42ab-a121-0871daf80309', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa438d18-3930-42ab-a121-0871daf80309', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b347d31c8b5d4368aea73e244e2cf8fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa438d18-3930-42ab-a121-0871daf80309', 'created_at': datetime.datetime(2026, 9, 28, 14, 59, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 59, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa438d18-3930-42ab-a121-0871daf80309/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ae3b8-087d-40b3-8670-b395c324e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Volume volume-4297bf12-18a4-41b9-90da-dde241fb522c (4297bf12-18a4-41b9-90da-dde241fb522c): created successfully Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906ae3b8-087d-40b3-8670-b395c324e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (cd84bc66-c800-4957-b453-2a51d90246a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f4403a0b-06b4-4cf0-861d-67eed1263dca tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:26:16 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb 1073741824" returned: 0 in 0.625s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb Sep 28 17:26:16 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:17 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" returned: 0 in 0.310s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec569aa6-c653-455a-b852-4bb0a77f06c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22baaf4-df97-41d1-92ca-2a524841e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Volume volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb (ccf5e9d0-a6bf-4020-95ba-12357ad47beb): created successfully Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22baaf4-df97-41d1-92ca-2a524841e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Flow 'volume_create_manager' (599cfcf2-c9ac-4102-9ca3-8dd312825f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f9644214-4b35-4e67-83bf-361bd32ec07c tempest-ProjectReaderTests-1630018868 None] Created volume successfully. Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "cinder-ccf5e9d0-a6bf-4020-95ba-12357ad47beb-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-ccf5e9d0-a6bf-4020-95ba-12357ad47beb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "cinder-quobyte-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-quobyte-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b6d97c-170b-491b-badc-7cd66536eab7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:18 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb Sep 28 17:26:18 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (b7373755-0a9a-4831-ae77-8505bc078009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3303855f-745d-47e1-b486-839a28ac1222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3303855f-745d-47e1-b486-839a28ac1222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1358336756',display_name='tempest-VolumesGetTest-Volume-1416026283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f488196c-7abc-4526-81bc-249ad4c22767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:19Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68ab8db-0f21-4af4-990d-c7a4c6fa2628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68ab8db-0f21-4af4-990d-c7a4c6fa2628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b875900-52f9-4b5f-b42b-3e928f752e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b875900-52f9-4b5f-b42b-3e928f752e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f488196c-7abc-4526-81bc-249ad4c22767', 'volume_name': 'volume-f488196c-7abc-4526-81bc-249ad4c22767', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9cc9ab-f974-4011-b34d-423a47543f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9cc9ab-f974-4011-b34d-423a47543f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b3dd5-4af9-480f-80b3-1c04e45accbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Volume f488196c-7abc-4526-81bc-249ad4c22767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f488196c-7abc-4526-81bc-249ad4c22767', 'volume_size': 1} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1358336756',display_name='tempest-VolumesGetTest-Volume-1416026283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f488196c-7abc-4526-81bc-249ad4c22767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9529e3cdfc164897ae489face38dfe48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:19Z,use_quota=True,user_id='3634c7f208ae45fd86ef5bd1bbedcac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Creating volume f488196c-7abc-4526-81bc-249ad4c22767 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:18 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 1073741824 Sep 28 17:26:18 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:19 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" returned: 0 in 0.484s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:19 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb Sep 28 17:26:19 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:19 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:19 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 1073741824" returned: 0 in 0.589s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" returned: 0 in 0.324s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-quobyte-ccf5e9d0-a6bf-4020-95ba-12357ad47beb" released by "delete_volume" :: held 0.876s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:19 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 Sep 28 17:26:19 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Created reservations ['f76ef427-13ac-401e-95f6-71914ebced46', '03509747-6a63-4bac-9649-dee04472126a', '191c121c-fab8-466b-9019-c263cc53eea1', '4baa0003-2793-484a-834d-c4500a4a3ef0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:19 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484b3dd5-4af9-480f-80b3-1c04e45accbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f488196c-7abc-4526-81bc-249ad4c22767', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da39dec4-76df-476e-acb7-bb7e7904b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:21 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:21 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Volume volume-f488196c-7abc-4526-81bc-249ad4c22767 (f488196c-7abc-4526-81bc-249ad4c22767): created successfully Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da39dec4-76df-476e-acb7-bb7e7904b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Flow 'volume_create_manager' (b7373755-0a9a-4831-ae77-8505bc078009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:21 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:21 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Deleted volume successfully. Sep 28 17:26:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f7a837aa-477a-456c-8d40-b7bed5709794 tempest-VolumesGetTest-702939044 None] Created volume successfully. Sep 28 17:26:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5750b445-babb-425d-affe-c4fd74390b99 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-ccf5e9d0-a6bf-4020-95ba-12357ad47beb-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-f488196c-7abc-4526-81bc-249ad4c22767-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "cinder-f488196c-7abc-4526-81bc-249ad4c22767-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Flow 'volume_create_manager' (4d07d08c-711b-4254-a456-5891aa2bb190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66271d4-f9f9-41e8-b901-f2707b0fbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66271d4-f9f9-41e8-b901-f2707b0fbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352696339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da714fc-3775-4726-8bf6-46b1c940c739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e88fd9259a4bcc914fbf6cdea953e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:26Z,use_quota=True,user_id='f7f6ec48334e4e5999fca89f36968c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33da4c0d-3d63-4267-8a0c-6177d4f6bc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33da4c0d-3d63-4267-8a0c-6177d4f6bc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073a86ee-3084-43f8-9ef9-364051466392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073a86ee-3084-43f8-9ef9-364051466392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da714fc-3775-4726-8bf6-46b1c940c739', 'volume_name': 'volume-7da714fc-3775-4726-8bf6-46b1c940c739', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b3fd98-a26e-45d8-82ad-80d00188c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44b3fd98-a26e-45d8-82ad-80d00188c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e3b860-f7d3-4603-8f21-11bf4585cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Volume 7da714fc-3775-4726-8bf6-46b1c940c739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da714fc-3775-4726-8bf6-46b1c940c739', 'volume_size': 1} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352696339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da714fc-3775-4726-8bf6-46b1c940c739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16e88fd9259a4bcc914fbf6cdea953e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:26Z,use_quota=True,user_id='f7f6ec48334e4e5999fca89f36968c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Creating volume 7da714fc-3775-4726-8bf6-46b1c940c739 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:25 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-f488196c-7abc-4526-81bc-249ad4c22767" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:26 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 1073741824 Sep 28 17:26:26 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-f488196c-7abc-4526-81bc-249ad4c22767" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4472e4-4ec6-4f3a-9475-01bb067ddd49]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 Sep 28 17:26:26 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767" returned: 0 in 0.510s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 1073741824" returned: 0 in 0.644s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767 Sep 28 17:26:26 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 Sep 28 17:26:26 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f488196c-7abc-4526-81bc-249ad4c22767" returned: 0 in 0.307s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-f488196c-7abc-4526-81bc-249ad4c22767" released by "delete_volume" :: held 0.913s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:27 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739" returned: 0 in 0.352s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e3b860-f7d3-4603-8f21-11bf4585cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da714fc-3775-4726-8bf6-46b1c940c739', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92da9b8-3cdf-44a3-b675-b4a558c34308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Created reservations ['e3cbb2a1-0b26-4f00-96ac-e623502a09ab', '06845f2a-ce3f-41c8-8466-c7760a6b65f5', '7de79496-db22-4885-94fd-c25e5fc70fc2', '2f54c1e1-b36f-4e89-89fe-5a031775fb60'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:27 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Volume volume-7da714fc-3775-4726-8bf6-46b1c940c739 (7da714fc-3775-4726-8bf6-46b1c940c739): created successfully Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92da9b8-3cdf-44a3-b675-b4a558c34308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Flow 'volume_create_manager' (4d07d08c-711b-4254-a456-5891aa2bb190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:27 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b402fc7d-0639-4bb1-a4fc-e6c7a2200286 tempest-ProjectReaderTests-1630018868 None] Created volume successfully. Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:27 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.280s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:27 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:26:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5332dd22-130c-426d-95e2-1aeb068e89e2 tempest-VolumesGetTest-702939044 None] Lock "cinder-f488196c-7abc-4526-81bc-249ad4c22767-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-4297bf12-18a4-41b9-90da-dde241fb522c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "cinder-7da714fc-3775-4726-8bf6-46b1c940c739-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "cinder-4297bf12-18a4-41b9-90da-dde241fb522c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-7da714fc-3775-4726-8bf6-46b1c940c739-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Acquiring lock "cinder-quobyte-4297bf12-18a4-41b9-90da-dde241fb522c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "cinder-quobyte-7da714fc-3775-4726-8bf6-46b1c940c739" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-4297bf12-18a4-41b9-90da-dde241fb522c" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-quobyte-7da714fc-3775-4726-8bf6-46b1c940c739" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53608ea-9993-40d9-b06d-b1dafef692b8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8095091-01f5-4b56-9d20-d0da779f3af7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c Sep 28 17:26:28 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 Sep 28 17:26:28 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c" returned: 0 in 0.491s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739" returned: 0 in 0.495s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c Sep 28 17:26:29 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739 Sep 28 17:26:29 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4297bf12-18a4-41b9-90da-dde241fb522c" returned: 0 in 0.316s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "cinder-quobyte-4297bf12-18a4-41b9-90da-dde241fb522c" released by "delete_volume" :: held 0.895s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:29 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-7da714fc-3775-4726-8bf6-46b1c940c739" returned: 0 in 0.344s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-quobyte-7da714fc-3775-4726-8bf6-46b1c940c739" released by "delete_volume" :: held 0.947s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Created reservations ['5752aa24-9ac4-4e78-9750-5ff7179a525c', 'be3e56b1-9756-45c7-8e95-41a04cac1b06', '7491f159-7782-456b-a7a9-a40771a15d62', 'fc1b4a7f-7411-494e-89cf-13d90c3b4497'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Created reservations ['b4b2074c-bed8-42bf-9be3-1b9fd7e79648', 'eec39657-5eb2-45a1-bb4b-34ea6e64ba66', '94e7fef3-a951-4e63-84e9-14d21d754bea', 'd35a64a0-e6f1-480a-a907-c390dda041aa'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:29 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:29 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Deleted volume successfully. Sep 28 17:26:29 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f4318aa0-a0b9-48db-b225-d9abfb25d18d tempest-VolumesGetTest-702939044 None] Lock "cinder-4297bf12-18a4-41b9-90da-dde241fb522c-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.296s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Deleted volume successfully. Sep 28 17:26:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6c13f526-270e-4991-93d4-a9a3f9613be6 tempest-ProjectReaderTests-1630018868 None] Lock "cinder-7da714fc-3775-4726-8bf6-46b1c940c739-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (c8e1a559-1c25-4af8-9467-197e090df222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06b056d-2735-4da6-a80e-93692211194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06b056d-2735-4da6-a80e-93692211194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169211501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5811edb-62eb-4c5f-abfb-68e66fe8d67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5792bf5-9b6c-4a92-a849-f50c326b8c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5792bf5-9b6c-4a92-a849-f50c326b8c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6306cd3-8d9e-43cc-a303-551eb8ef36ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6306cd3-8d9e-43cc-a303-551eb8ef36ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5811edb-62eb-4c5f-abfb-68e66fe8d67a', 'volume_name': 'volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cfec8d-d7f7-4c3d-a4ac-2b19463ab8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cfec8d-d7f7-4c3d-a4ac-2b19463ab8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10bfdac-1190-4d29-929e-36c6085c03a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Volume d5811edb-62eb-4c5f-abfb-68e66fe8d67a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a', 'volume_size': 1} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169211501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5811edb-62eb-4c5f-abfb-68e66fe8d67a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Creating volume d5811edb-62eb-4c5f-abfb-68e66fe8d67a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:31 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a 1073741824 Sep 28 17:26:31 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a 1073741824" returned: 0 in 0.707s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a Sep 28 17:26:32 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10bfdac-1190-4d29-929e-36c6085c03a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cfcebe-781d-4692-8209-16275447d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Volume volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a (d5811edb-62eb-4c5f-abfb-68e66fe8d67a): created successfully Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9cfcebe-781d-4692-8209-16275447d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (c8e1a559-1c25-4af8-9467-197e090df222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e06dcdc4-b230-46f5-90b2-701d531ec901 tempest-ProjectReaderTests-461642400 None] Created volume successfully. Sep 28 17:26:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-d5811edb-62eb-4c5f-abfb-68e66fe8d67a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "cinder-d5811edb-62eb-4c5f-abfb-68e66fe8d67a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-quobyte-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ade47ff-5934-4826-a398-797f100d1953]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a Sep 28 17:26:34 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" returned: 0 in 0.454s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a Sep 28 17:26:34 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" returned: 0 in 0.367s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-d5811edb-62eb-4c5f-abfb-68e66fe8d67a" released by "delete_volume" :: held 0.887s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Created reservations ['44e65e89-fdf1-4fe8-805c-add568f02692', '704f8bc7-8ea0-4710-96db-bf06be752866', 'ec5ccfca-a88a-4814-beed-1c1a4aa5d934', 'cbc30e80-508c-40ce-80e1-08bed759e733'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:35 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.429s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Deleted volume successfully. Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5c5682e9-d8a1-49ce-9843-330f02f8e818 tempest-ProjectReaderTests-461642400 None] Lock "cinder-d5811edb-62eb-4c5f-abfb-68e66fe8d67a-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (c2fa3381-ba4e-4b66-95dc-2d85aae5c0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c63919-6dde-432b-b1d5-a1574838aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c63919-6dde-432b-b1d5-a1574838aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996033618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b9a3c7-a977-46a5-9b72-519a71ec3177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:36Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1b646-7e97-4db3-b290-692a9467e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf1b646-7e97-4db3-b290-692a9467e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1e814-b808-42c6-ad35-a2135b3ad012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff1e814-b808-42c6-ad35-a2135b3ad012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b9a3c7-a977-46a5-9b72-519a71ec3177', 'volume_name': 'volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99d6cb-5fef-4563-bb79-5a9e717e0d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99d6cb-5fef-4563-bb79-5a9e717e0d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d54820-6da2-4a02-b124-792a015c9a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Volume c8b9a3c7-a977-46a5-9b72-519a71ec3177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177', 'volume_size': 1} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996033618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b9a3c7-a977-46a5-9b72-519a71ec3177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:36Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Creating volume c8b9a3c7-a977-46a5-9b72-519a71ec3177 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:35 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 1073741824 Sep 28 17:26:36 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Flow 'volume_create_manager' (4f6fab5a-035b-4ccd-b07e-2e21c21e63d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db378d1c-fe74-48bd-9fc5-bd96fae0cc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db378d1c-fe74-48bd-9fc5-bd96fae0cc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-337825093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d35ed6c-2d91-4edd-bf17-0158c31d975c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50959db96e94ec0883fc258ec154964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:36Z,use_quota=True,user_id='513a7dc838a54467b336e7b53760cdcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c79b8b3-606b-41cc-b580-6585c4160750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c79b8b3-606b-41cc-b580-6585c4160750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6412392-0110-4aef-8444-b13d35f9992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6412392-0110-4aef-8444-b13d35f9992a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d35ed6c-2d91-4edd-bf17-0158c31d975c', 'volume_name': 'volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c', 'volume_size': 2}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5850eb4-9707-4a13-8a98-03ec15e39c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5850eb4-9707-4a13-8a98-03ec15e39c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6be15-f219-4bad-b214-74fbc18590cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Volume 5d35ed6c-2d91-4edd-bf17-0158c31d975c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c', 'volume_size': 2} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:36 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 1073741824" returned: 0 in 0.569s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 Sep 28 17:26:36 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-337825093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d35ed6c-2d91-4edd-bf17-0158c31d975c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50959db96e94ec0883fc258ec154964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:36Z,use_quota=True,user_id='513a7dc838a54467b336e7b53760cdcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Creating volume 5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:36 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c 2147483648 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d54820-6da2-4a02-b124-792a015c9a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8403ed26-6ca6-44a0-bb73-00ad73cdd80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c 2147483648 Sep 28 17:26:36 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Volume volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 (c8b9a3c7-a977-46a5-9b72-519a71ec3177): created successfully Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8403ed26-6ca6-44a0-bb73-00ad73cdd80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (c2fa3381-ba4e-4b66-95dc-2d85aae5c0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b00a05a9-456a-41e8-9889-0f3a20e10651 tempest-ProjectReaderTests-461642400 None] Created volume successfully. Sep 28 17:26:37 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c 2147483648" returned: 0 in 0.597s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c Sep 28 17:26:37 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c" returned: 0 in 0.293s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce6be15-f219-4bad-b214-74fbc18590cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c', 'volume_size': 2}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c3ec36-72e2-4fbc-a5eb-096d718cd280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:37 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Volume volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c (5d35ed6c-2d91-4edd-bf17-0158c31d975c): created successfully Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c3ec36-72e2-4fbc-a5eb-096d718cd280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Flow 'volume_create_manager' (4f6fab5a-035b-4ccd-b07e-2e21c21e63d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cc670bc8-f1ff-4c64-9188-24875a608e85 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Created volume successfully. Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-c8b9a3c7-a977-46a5-9b72-519a71ec3177-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "cinder-c8b9a3c7-a977-46a5-9b72-519a71ec3177-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-quobyte-c8b9a3c7-a977-46a5-9b72-519a71ec3177" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-c8b9a3c7-a977-46a5-9b72-519a71ec3177" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ffd8a5-0bd1-43d5-926e-eef8de67c5f6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 Sep 28 17:26:38 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177" returned: 0 in 0.452s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177 Sep 28 17:26:38 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Creating offline snapshot d82b8725-ed8e-432b-b109-e226b05a27c0 of volume 5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f2f30e-4c4f-403a-9594-47c8fa395b89]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8b9a3c7-a977-46a5-9b72-519a71ec3177" returned: 0 in 0.306s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-c8b9a3c7-a977-46a5-9b72-519a71ec3177" released by "delete_volume" :: held 0.824s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:38 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c Sep 28 17:26:38 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Created reservations ['abf93621-3506-406a-a186-0cd563086e72', 'dcaab8a3-7274-40d4-a629-29e23ffedfb5', 'c3169dbc-f095-4d56-bed1-84362233a586', 'f8181645-e5e6-408d-8f8b-f48573970152'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:39 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c" returned: 0 in 0.623s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 2G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.316s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:39 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 2G Sep 28 17:26:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Deleted volume successfully. Sep 28 17:26:39 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3a434d9-02c2-494c-9f57-77a0278e99d1 tempest-ProjectReaderTests-461642400 None] Lock "cinder-c8b9a3c7-a977-46a5-9b72-519a71ec3177-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (f459e81e-76b2-4c39-9074-35f18726fba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a970d62-4c07-47da-992d-0dcfa13c3ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a970d62-4c07-47da-992d-0dcfa13c3ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567990001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d21c709-885f-44eb-9518-6107f3add648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:40Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3e636-bb58-4e87-a414-473ab0f0b31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d3e636-bb58-4e87-a414-473ab0f0b31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397448d6-b080-4035-8e6f-f883fccd4052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397448d6-b080-4035-8e6f-f883fccd4052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d21c709-885f-44eb-9518-6107f3add648', 'volume_name': 'volume-0d21c709-885f-44eb-9518-6107f3add648', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b2f4ea-aea6-45a1-b63f-44ba771ab4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b2f4ea-aea6-45a1-b63f-44ba771ab4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03a362-4794-42b8-bbc9-fd9a1d17d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Volume 0d21c709-885f-44eb-9518-6107f3add648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d21c709-885f-44eb-9518-6107f3add648', 'volume_size': 1} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:39 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 2G" returned: 0 in 0.546s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 Sep 28 17:26:39 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0" returned: 0 in 0.322s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 is being set with open permissions: ugo+rw Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 Sep 28 17:26:40 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0" returned: 0 in 0.250s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info Sep 28 17:26:40 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info" returned: 0 in 0.268s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info is being set with open permissions: ugo+rw Sep 28 17:26:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info Sep 28 17:26:40 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.info" returned: 0 in 0.254s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567990001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d21c709-885f-44eb-9518-6107f3add648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:40Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Creating volume 0d21c709-885f-44eb-9518-6107f3add648 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 1073741824 Sep 28 17:26:41 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-339d3d63-4836-4917-acfa-59653db7b7ef tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Create snapshot completed successfully Sep 28 17:26:41 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 1073741824" returned: 0 in 0.427s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 Sep 28 17:26:41 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648" returned: 0 in 0.255s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc03a362-4794-42b8-bbc9-fd9a1d17d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d21c709-885f-44eb-9518-6107f3add648', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f1e73b-9656-4d47-8bb0-1421bebf7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Volume volume-0d21c709-885f-44eb-9518-6107f3add648 (0d21c709-885f-44eb-9518-6107f3add648): created successfully Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f1e73b-9656-4d47-8bb0-1421bebf7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (f459e81e-76b2-4c39-9074-35f18726fba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fd780709-7e86-43af-aeac-cdd4fa341f40 tempest-ProjectReaderTests-461642400 None] Created volume successfully. Sep 28 17:26:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "cinder-d82b8725-ed8e-432b-b109-e226b05a27c0-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-d82b8725-ed8e-432b-b109-e226b05a27c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "cinder-quobyte-d82b8725-ed8e-432b-b109-e226b05a27c0" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-d82b8725-ed8e-432b-b109-e226b05a27c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Deleting offline snapshot d82b8725-ed8e-432b-b109-e226b05a27c0 of volume 5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] snapshot_file for this snap is: volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b118b8-f8d4-4ac9-953c-ffeae257add7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 Sep 28 17:26:42 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[089eb30d-8b94-41d4-8edc-823b5cefd4d5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c Sep 28 17:26:42 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c" returned: 0 in 0.391s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 Sep 28 17:26:42 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-0d21c709-885f-44eb-9518-6107f3add648-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "cinder-0d21c709-885f-44eb-9518-6107f3add648-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-quobyte-0d21c709-885f-44eb-9518-6107f3add648" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-0d21c709-885f-44eb-9518-6107f3add648" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af57290-8356-44e1-8102-8fc506cea96f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 Sep 28 17:26:43 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0" returned: 0 in 0.422s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0 Sep 28 17:26:43 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c.d82b8725-ed8e-432b-b109-e226b05a27c0" returned: 0 in 0.323s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648" returned: 0 in 0.468s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648 Sep 28 17:26:43 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-d82b8725-ed8e-432b-b109-e226b05a27c0" released by "_delete_snapshot" :: held 1.660s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" released by "delete_snapshot" :: held 1.685s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Created reservations ['1fe2bf4d-5ad4-4782-a3d7-024d62e75c38', '5258be25-331c-4951-9303-205bf281da0b', '5776ec4c-4e0f-4807-a6d2-a8074297a405', 'd477feab-b183-40d7-9ad1-6ab64e18d0ed'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Delete snapshot completed successfully. Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-86ace3ca-9d87-4fd5-b7b7-121a001cbcc2 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-d82b8725-ed8e-432b-b109-e226b05a27c0-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0d21c709-885f-44eb-9518-6107f3add648" returned: 0 in 0.275s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-0d21c709-885f-44eb-9518-6107f3add648" released by "delete_volume" :: held 0.790s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Created reservations ['7f491c41-4049-4015-99b0-c3b97f51e7e4', '2aa0b72f-0cc5-40d9-9d33-8edfefa94ac7', '1ae8eeec-6021-446f-978c-66c961f03821', '8d371207-4d1b-4474-8022-bb13113d9a50'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:44 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "cinder-5d35ed6c-2d91-4edd-bf17-0158c31d975c-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-5d35ed6c-2d91-4edd-bf17-0158c31d975c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:44 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.302s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Deleted volume successfully. Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aaa0abe2-0fea-444b-8cb2-1fafd1e3c913 tempest-ProjectReaderTests-461642400 None] Lock "cinder-0d21c709-885f-44eb-9518-6107f3add648-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e70ae7-6800-427f-a12f-b41ff4d47613]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c Sep 28 17:26:44 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (61e8e184-6dfb-4f5d-8706-97e58137ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d12f1-bafd-4f52-98d1-872cc36c7841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d12f1-bafd-4f52-98d1-872cc36c7841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366881780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569c94e8-20e8-4b14-a571-a699e4aa02c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:45Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eebf0b-8201-442f-a611-77fe914c6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eebf0b-8201-442f-a611-77fe914c6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18392683-06b7-49f0-b676-0d6de8b6bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18392683-06b7-49f0-b676-0d6de8b6bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569c94e8-20e8-4b14-a571-a699e4aa02c4', 'volume_name': 'volume-569c94e8-20e8-4b14-a571-a699e4aa02c4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb8c1e3-081f-4f16-8dc0-c987754e67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb8c1e3-081f-4f16-8dc0-c987754e67f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3abe02-92de-4129-b3a0-2a8fb6d2a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Volume 569c94e8-20e8-4b14-a571-a699e4aa02c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569c94e8-20e8-4b14-a571-a699e4aa02c4', 'volume_size': 1} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-366881780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569c94e8-20e8-4b14-a571-a699e4aa02c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee48cf7e4f3a474391bebc7ff38a2d6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:45Z,use_quota=True,user_id='36187d514b274bf49e9e802d04dbc831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Creating volume 569c94e8-20e8-4b14-a571-a699e4aa02c4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:44 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c" returned: 0 in 0.455s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 1073741824 Sep 28 17:26:44 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c Sep 28 17:26:44 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5d35ed6c-2d91-4edd-bf17-0158c31d975c" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-quobyte-5d35ed6c-2d91-4edd-bf17-0158c31d975c" released by "delete_volume" :: held 0.804s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Created reservations ['e6b28632-c5d6-40eb-8294-4244d52c1552', '5b720b72-5075-46c1-af45-e72a1b8e67af', 'ee2a9f3d-456b-4884-9946-a3745ef7598f', '40aa7c50-3821-4675-a691-012565b76521'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:45 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 1073741824" returned: 0 in 0.522s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 Sep 28 17:26:45 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.313s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Deleted volume successfully. Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ab93a929-0830-469c-adde-20ecfe873992 tempest-VolumesSnapshotNegativeTestJSON-500570452 None] Lock "cinder-5d35ed6c-2d91-4edd-bf17-0158c31d975c-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4" returned: 0 in 0.317s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3abe02-92de-4129-b3a0-2a8fb6d2a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569c94e8-20e8-4b14-a571-a699e4aa02c4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69130436-c087-429b-842c-b6622e69f46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Volume volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 (569c94e8-20e8-4b14-a571-a699e4aa02c4): created successfully Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69130436-c087-429b-842c-b6622e69f46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Flow 'volume_create_manager' (61e8e184-6dfb-4f5d-8706-97e58137ff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4664eaf0-968c-494f-85b1-ca160d0e2134 tempest-ProjectReaderTests-461642400 None] Created volume successfully. Sep 28 17:26:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-569c94e8-20e8-4b14-a571-a699e4aa02c4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "cinder-569c94e8-20e8-4b14-a571-a699e4aa02c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Acquiring lock "cinder-quobyte-569c94e8-20e8-4b14-a571-a699e4aa02c4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-569c94e8-20e8-4b14-a571-a699e4aa02c4" acquired by "delete_volume" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c64fc-0891-407b-a35d-d802f729b71f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 Sep 28 17:26:47 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4 Sep 28 17:26:47 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-569c94e8-20e8-4b14-a571-a699e4aa02c4" returned: 0 in 0.265s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "cinder-quobyte-569c94e8-20e8-4b14-a571-a699e4aa02c4" released by "delete_volume" :: held 0.712s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Created reservations ['847c12c2-e831-4a8c-89fd-6784cb589c90', 'fe10c16a-a8cf-4016-a1db-393e051c89ff', '17d2f938-5586-4ed1-8efa-22c09128b93f', 'fb820ecb-aa0d-4930-8ba9-e6d6afac3b5e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:26:47 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:48 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.303s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:48 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Deleted volume successfully. Sep 28 17:26:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-dc1aaf6f-6268-45b0-b550-252808819684 tempest-ProjectReaderTests-461642400 None] Lock "cinder-569c94e8-20e8-4b14-a571-a699e4aa02c4-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:57 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=79,cinder:UPDATE=117,cinder:DELETE=9,cinder:INSERT=33 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:58 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=85,cinder:INSERT=32,cinder:UPDATE=112,cinder:DELETE=12 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:07 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:27:07 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:07 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.279s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:27:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:27:08 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Flow 'volume_create_manager' (4efcb056-e624-4885-ba3e-bd44c34aa734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3e28a2-83d4-42e0-aaed-2f0379bd2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3e28a2-83d4-42e0-aaed-2f0379bd2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1512074170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d324b1ac-8623-491d-9f76-9683e89baa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d709d78fd64ecfb5f93ac856c5bf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:12Z,use_quota=True,user_id='fd556fa5fcb54425b2ac02251c0cd3f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5e4f53-b3dc-487c-989b-7e83119b6a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5e4f53-b3dc-487c-989b-7e83119b6a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55af4c26-f761-477f-9879-9f625c49f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55af4c26-f761-477f-9879-9f625c49f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd324b1ac-8623-491d-9f76-9683e89baa29', 'volume_name': 'volume-d324b1ac-8623-491d-9f76-9683e89baa29', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f2ee29-b2be-4176-bc71-5a39fdf37748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f2ee29-b2be-4176-bc71-5a39fdf37748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbba557-a7bb-4c3f-9f72-bf38f08ce337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:15 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Volume d324b1ac-8623-491d-9f76-9683e89baa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d324b1ac-8623-491d-9f76-9683e89baa29', 'volume_size': 1} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1512074170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d324b1ac-8623-491d-9f76-9683e89baa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d709d78fd64ecfb5f93ac856c5bf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:12Z,use_quota=True,user_id='fd556fa5fcb54425b2ac02251c0cd3f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Creating volume d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:15 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:27:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:15 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 1073741824 Sep 28 17:27:15 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:16 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 1073741824" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:27:18 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] <== create_volume: return (2461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cbba557-a7bb-4c3f-9f72-bf38f08ce337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d324b1ac-8623-491d-9f76-9683e89baa29', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1581fb8a-5665-4b78-8342-fc6d9dcfa8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:18 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Volume volume-d324b1ac-8623-491d-9f76-9683e89baa29 (d324b1ac-8623-491d-9f76-9683e89baa29): created successfully Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1581fb8a-5665-4b78-8342-fc6d9dcfa8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:18 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Flow 'volume_create_manager' (4efcb056-e624-4885-ba3e-bd44c34aa734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:18 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fc998a2d-52cb-4756-a46d-9eb9247817b0 tempest-TestStampPattern-1781017173 None] Created volume successfully. Sep 28 17:27:28 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:28 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f2359dab-b65c-4322-b0b0-90a85eeda1c9 req-69ae6d74-7439-454e-81db-67d1b8b3e861 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f2359dab-b65c-4322-b0b0-90a85eeda1c9 req-69ae6d74-7439-454e-81db-67d1b8b3e861 tempest-TestStampPattern-1781017173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-f2359dab-b65c-4322-b0b0-90a85eeda1c9 req-69ae6d74-7439-454e-81db-67d1b8b3e861 tempest-TestStampPattern-1781017173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-f2359dab-b65c-4322-b0b0-90a85eeda1c9 req-69ae6d74-7439-454e-81db-67d1b8b3e861 tempest-TestStampPattern-1781017173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-d324b1ac-8623-491d-9f76-9683e89baa29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c36417fc-4e66-4674-b285-fb7578308f36', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:27:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-f2359dab-b65c-4322-b0b0-90a85eeda1c9 req-69ae6d74-7439-454e-81db-67d1b8b3e861 tempest-TestStampPattern-1781017173 None] attachment_update completed successfully. Sep 28 17:27:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-9c62b106-449b-431f-9792-657399d749b4 req-56c0a532-3305-4c6f-badd-3b0cb7200afb tempest-TestStampPattern-1781017173 None] Terminate volume connection completed successfully. Sep 28 17:27:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-9c62b106-449b-431f-9792-657399d749b4 req-56c0a532-3305-4c6f-badd-3b0cb7200afb tempest-TestStampPattern-1781017173 None] Deleting attachment c36417fc-4e66-4674-b285-fb7578308f36. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Creating offline snapshot f420b193-4d46-49c2-a3d7-3ed320056ec0 of volume d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3e222-5b68-4d65-9d5b-c0d60d046809]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:27:55 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.368s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 1G Sep 28 17:27:55 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 1G" returned: 0 in 0.424s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d324b1ac-8623-491d-9f76-9683e89baa29 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d324b1ac-8623-491d-9f76-9683e89baa29 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:27:56 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d324b1ac-8623-491d-9f76-9683e89baa29 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.298s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 is being set with open permissions: ugo+rw Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:27:56 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.266s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info Sep 28 17:27:56 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info" returned: 0 in 0.267s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info is being set with open permissions: ugo+rw Sep 28 17:27:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info Sep 28 17:27:57 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.info" returned: 0 in 0.245s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a1d46b09-e0fc-4ce6-9f1c-157d651e6017 tempest-TestStampPattern-1781017173 None] Create snapshot completed successfully Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Flow 'volume_create_manager' (bd6bd33f-395c-4b1f-8906-ef15f9522cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d45b15e-7992-4346-a04b-843d741a2313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d45b15e-7992-4346-a04b-843d741a2313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-601245180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb0b9c8-69c2-4f22-819a-7ae03a087b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d709d78fd64ecfb5f93ac856c5bf6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f420b193-4d46-49c2-a3d7-3ed320056ec0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:04Z,use_quota=True,user_id='fd556fa5fcb54425b2ac02251c0cd3f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2566783-ca11-4ea4-9568-ad788ad6b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2566783-ca11-4ea4-9568-ad788ad6b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42eb221-8ed5-4c86-a2bd-8bf8d867db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42eb221-8ed5-4c86-a2bd-8bf8d867db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ccb0b9c8-69c2-4f22-819a-7ae03a087b01', 'volume_name': 'volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01', 'volume_size': 1, 'snapshot_id': 'f420b193-4d46-49c2-a3d7-3ed320056ec0'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7acd5d-6600-4398-bf20-aa0e628ba781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7acd5d-6600-4398-bf20-aa0e628ba781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b6f8ef-4622-4bb1-8767-6771a9365180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:04 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Volume ccb0b9c8-69c2-4f22-819a-7ae03a087b01: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01', 'volume_size': 1, 'snapshot_id': 'f420b193-4d46-49c2-a3d7-3ed320056ec0'} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Creating volume ccb0b9c8-69c2-4f22-819a-7ae03a087b01 from snapshot f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] snapshot: f420b193-4d46-49c2-a3d7-3ed320056ec0, volume: ccb0b9c8-69c2-4f22-819a-7ae03a087b01, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d23a7f3-a8ca-405e-b16c-d5cf6510d3c4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:28:04 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.399s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d324b1ac-8623-491d-9f76-9683e89baa29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aa1f84-0f7f-4ddb-8009-1ee1c0a7c603]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:28:05 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.417s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:28:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:28:05 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:28:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 Sep 28 17:28:05 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:28:07 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:08 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:28:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" returned: 0 in 8.843s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:28:14 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Converted 1024.00 MB image at 115.78 MB/s Sep 28 17:28:14 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 is being set with open permissions: ugo+rw Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 Sep 28 17:28:14 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:14 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" returned: 0 in 0.329s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" released by "_copy_volume_from_snapshot" :: held 10.083s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" released by "_create_volume_from_snapshot" :: held 10.151s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.170s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b6f8ef-4622-4bb1-8767-6771a9365180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01', 'volume_size': 1, 'snapshot_id': 'f420b193-4d46-49c2-a3d7-3ed320056ec0'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8fd68f-b261-4a87-a161-09bf8e1a6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Volume volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 (ccb0b9c8-69c2-4f22-819a-7ae03a087b01): created successfully Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8fd68f-b261-4a87-a161-09bf8e1a6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Flow 'volume_create_manager' (bd6bd33f-395c-4b1f-8906-ef15f9522cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:14 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9175513c-8085-4d1c-83ff-7c6004d4b904 tempest-TestStampPattern-1781017173 None] Created volume successfully. Sep 28 17:28:24 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:24 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-6318364c-3aa7-4355-aae8-5bfe9364a704 req-f83749e1-2647-4a5a-968c-231b747e1737 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-6318364c-3aa7-4355-aae8-5bfe9364a704 req-f83749e1-2647-4a5a-968c-231b747e1737 tempest-TestStampPattern-1781017173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [req-6318364c-3aa7-4355-aae8-5bfe9364a704 req-f83749e1-2647-4a5a-968c-231b747e1737 tempest-TestStampPattern-1781017173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-6318364c-3aa7-4355-aae8-5bfe9364a704 req-f83749e1-2647-4a5a-968c-231b747e1737 tempest-TestStampPattern-1781017173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e', 'name': 'volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '480ae492-fc9b-4a89-8e7d-edf36f3b53b2', 'enforce_multipath': True} {{(pid=86929) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:28:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-6318364c-3aa7-4355-aae8-5bfe9364a704 req-f83749e1-2647-4a5a-968c-231b747e1737 tempest-TestStampPattern-1781017173 None] attachment_update completed successfully. Sep 28 17:28:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [req-a9f33523-7ff9-4450-b5ed-b24c2d70d23b req-02b25ee7-757c-4783-a0c8-449b5b3cbcfc tempest-TestStampPattern-1781017173 None] Terminate volume connection completed successfully. Sep 28 17:28:59 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [req-a9f33523-7ff9-4450-b5ed-b24c2d70d23b req-02b25ee7-757c-4783-a0c8-449b5b3cbcfc tempest-TestStampPattern-1781017173 None] Deleting attachment 480ae492-fc9b-4a89-8e7d-edf36f3b53b2. {{(pid=86929) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-ccb0b9c8-69c2-4f22-819a-7ae03a087b01-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "cinder-ccb0b9c8-69c2-4f22-819a-7ae03a087b01-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" acquired by "delete_volume" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[814d8184-9395-407e-83d2-854fcc13f516]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 Sep 28 17:29:04 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" returned: 0 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01 Sep 28 17:29:04 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:04 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" returned: 0 in 0.246s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-ccb0b9c8-69c2-4f22-819a-7ae03a087b01" released by "delete_volume" :: held 0.660s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Created reservations ['ff63c303-4bb0-4225-b1de-b406825b2255', 'e293b5c8-963d-4d6e-8548-2cf7c5a070b3', 'a0516928-de8e-4ffc-ad4f-65def45914ff', '0521c169-fc1d-4bed-a075-40be21eba46c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:04 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:04 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.261s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Deleted volume successfully. Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3ed4f912-7eda-4ece-b06e-011cfa4002a3 tempest-TestStampPattern-1781017173 None] Lock "cinder-ccb0b9c8-69c2-4f22-819a-7ae03a087b01-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-f420b193-4d46-49c2-a3d7-3ed320056ec0-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-f420b193-4d46-49c2-a3d7-3ed320056ec0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Deleting offline snapshot f420b193-4d46-49c2-a3d7-3ed320056ec0 of volume d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] snapshot_file for this snap is: volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c466a48-cd5e-450c-a1a6-972c104859b0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:05 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:29:05 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:05 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.364s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d324b1ac-8623-491d-9f76-9683e89baa29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20c5cdb-2a1b-4ae0-8f52-f6b7a60920e2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:29:06 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.534s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:29:06 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:06 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.325s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:06 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0 Sep 28 17:29:06 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29.f420b193-4d46-49c2-a3d7-3ed320056ec0" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-f420b193-4d46-49c2-a3d7-3ed320056ec0" released by "_delete_snapshot" :: held 1.606s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" released by "delete_snapshot" :: held 1.633s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Created reservations ['4961af13-178c-4742-858a-0e2a0319b865', 'a1fa29c8-5c02-445f-8540-f5f49e15348e', '24769dd1-4bad-4b4e-aed7-a41ec7b508c0', '29f60080-9ffe-4769-9d00-26b6b029eb28'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Delete snapshot completed successfully. Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b48f1e20-da50-409e-ad33-9ecd5304329f tempest-TestStampPattern-1781017173 None] Lock "cinder-f420b193-4d46-49c2-a3d7-3ed320056ec0-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:07 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:07 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:07 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:29:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-d324b1ac-8623-491d-9f76-9683e89baa29-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "cinder-d324b1ac-8623-491d-9f76-9683e89baa29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Acquiring lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0717f7ce-0c31-4d52-9acf-7418e02da8be]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:29:11 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:11 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.363s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:11 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29 Sep 28 17:29:11 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:12 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d324b1ac-8623-491d-9f76-9683e89baa29" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "cinder-quobyte-d324b1ac-8623-491d-9f76-9683e89baa29" released by "delete_volume" :: held 0.674s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Created reservations ['546c34b6-9290-4f56-b26e-aec90f549d89', '059994fd-2ae1-4d34-bf55-0f09fea025f3', '8bb4987c-312a-4f9f-84a8-95844de94a7f', 'dada0b60-8963-47b6-ab8d-488e07d4073b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:12 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:12 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:12 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Deleted volume successfully. Sep 28 17:29:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a96f5f01-7ff1-4e00-b5e2-fd261628ddc9 tempest-TestStampPattern-1781017173 None] Lock "cinder-d324b1ac-8623-491d-9f76-9683e89baa29-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:22 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:22 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Flow 'volume_create_manager' (e169a132-641c-4ca8-9731-3d529a3a1f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d79c53-9391-427c-b9b7-3d3ebcc6ef06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d79c53-9391-427c-b9b7-3d3ebcc6ef06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b594c22-56d7-4555-9b62-1e37e0216514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1c273dfd2d4a41b3d263bd3d78c0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:29Z,use_quota=True,user_id='82b1cfcc64fe4c0cbcfc8d7e736a23c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8892878c-d094-4587-9f12-367a144389b3),volume_type_id=8892878c-d094-4587-9f12-367a144389b3)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dc01d7-c94a-43f8-a110-773dffffcad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43dc01d7-c94a-43f8-a110-773dffffcad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a799cec1-17c3-4b37-829c-3a721109cf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a799cec1-17c3-4b37-829c-3a721109cf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b594c22-56d7-4555-9b62-1e37e0216514', 'volume_name': 'volume-5b594c22-56d7-4555-9b62-1e37e0216514', 'volume_size': 1, 'image_id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ce7bb4d99f6c5886a3886898af54703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1c273dfd2d4a41b3d263bd3d78c0a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26bf53a050715ce5a8b6bdb2f10c243846f97cc5a53b870cf550453f37aa23b105ffe2c0870e3ad072f597df4fe4856ea4711c6b48b57e91004493dcf9d1dd8f', 'id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed2718e-c79d-42bf-9101-18060eef96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed2718e-c79d-42bf-9101-18060eef96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c1a887-aa06-4a68-8777-045a45325b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Volume 5b594c22-56d7-4555-9b62-1e37e0216514: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b594c22-56d7-4555-9b62-1e37e0216514', 'volume_size': 1, 'image_id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ce7bb4d99f6c5886a3886898af54703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1c273dfd2d4a41b3d263bd3d78c0a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26bf53a050715ce5a8b6bdb2f10c243846f97cc5a53b870cf550453f37aa23b105ffe2c0870e3ad072f597df4fe4856ea4711c6b48b57e91004493dcf9d1dd8f', 'id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Trying to clone 5b594c22-56d7-4555-9b62-1e37e0216514 from image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:29:29 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee908e-d9b3-42a9-92bf-e4cbd4fb52b7]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:29 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:30 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Temporary image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd is fetched for user 82b1cfcc64fe4c0cbcfc8d7e736a23c7. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c58974-6479-48f1-8741-6866d8ad92b5]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:30 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:31 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b594c22-56d7-4555-9b62-1e37e0216514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1c273dfd2d4a41b3d263bd3d78c0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:29Z,use_quota=True,user_id='82b1cfcc64fe4c0cbcfc8d7e736a23c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8892878c-d094-4587-9f12-367a144389b3),volume_type_id=8892878c-d094-4587-9f12-367a144389b3)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Creating volume 5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:31 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1073741824 Sep 28 17:29:31 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1073741824" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 Sep 28 17:29:31 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514" returned: 0 in 0.244s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Attempting download of 75ee9ef3-f140-4155-8b39-0ecd29a00dfd ((None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}])) to volume 5b594c22-56d7-4555-9b62-1e37e0216514. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe996ef2-8f41-4633-a08c-e94ad89a7007]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w Sep 28 17:29:32 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w" returned: 0 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w Sep 28 17:29:32 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w" returned: 1 in 0.323s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_68f5q75w' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7999d391-0a08-49cc-a901-131ec91ab641]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:32 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD Sep 28 17:29:33 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] 75ee9ef3-f140-4155-8b39-0ecd29a00dfd was raw, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 Sep 28 17:29:33 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:33 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514" returned: 0 in 0.453s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75ee9ef3-f140-4155-8b39-0ecd29a00dfd_ko8m3oi7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:33 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:29:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:33 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1G Sep 28 17:29:33 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:34 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 1G" returned: 0 in 0.354s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Downloaded image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd ((None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}])) to volume 5b594c22-56d7-4555-9b62-1e37e0216514 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Temporary image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd for user 82b1cfcc64fe4c0cbcfc8d7e736a23c7 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Marking volume 5b594c22-56d7-4555-9b62-1e37e0216514 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Copying metadata from image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd to 5b594c22-56d7-4555-9b62-1e37e0216514. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Creating volume glance metadata for volume 5b594c22-56d7-4555-9b62-1e37e0216514 backed by image 75ee9ef3-f140-4155-8b39-0ecd29a00dfd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6ce7bb4d99f6c5886a3886898af54703', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c1a887-aa06-4a68-8777-045a45325b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b594c22-56d7-4555-9b62-1e37e0216514', 'volume_size': 1, 'image_id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ce7bb4d99f6c5886a3886898af54703', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e1c273dfd2d4a41b3d263bd3d78c0a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '26bf53a050715ce5a8b6bdb2f10c243846f97cc5a53b870cf550453f37aa23b105ffe2c0870e3ad072f597df4fe4856ea4711c6b48b57e91004493dcf9d1dd8f', 'id': '75ee9ef3-f140-4155-8b39-0ecd29a00dfd', 'created_at': datetime.datetime(2026, 9, 28, 15, 29, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 29, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75ee9ef3-f140-4155-8b39-0ecd29a00dfd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0efedb-baa5-45ae-bdc6-890dea5fe81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:34 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Volume volume-5b594c22-56d7-4555-9b62-1e37e0216514 (5b594c22-56d7-4555-9b62-1e37e0216514): created successfully Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b0efedb-baa5-45ae-bdc6-890dea5fe81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Flow 'volume_create_manager' (e169a132-641c-4ca8-9731-3d529a3a1f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-52c05f50-966e-4464-8e1c-0b685a8a5ec2 tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Created volume successfully. Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Acquiring lock "cinder-5b594c22-56d7-4555-9b62-1e37e0216514-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "cinder-5b594c22-56d7-4555-9b62-1e37e0216514-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Acquiring lock "cinder-quobyte-5b594c22-56d7-4555-9b62-1e37e0216514" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "cinder-quobyte-5b594c22-56d7-4555-9b62-1e37e0216514" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2caf5dc-8bed-40f1-9633-727e74b9ab69]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:34 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 Sep 28 17:29:34 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514" returned: 0 in 0.379s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:35 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514 Sep 28 17:29:35 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5b594c22-56d7-4555-9b62-1e37e0216514" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "cinder-quobyte-5b594c22-56d7-4555-9b62-1e37e0216514" released by "delete_volume" :: held 0.684s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:35 devstack cinder-volume[86929]: WARNING cinder.quota [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:29:35 devstack cinder-volume[86929]: WARNING cinder.quota [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Created reservations ['b66cd0e8-2f99-49f5-9532-23709a1274d8', '42585ad4-b8f3-4464-a3d0-4ef2a1e8e421', '915e1751-9bbb-423b-978b-0e50a0024ac2', 'e34011c5-3a19-447d-946a-1fb72aae9d37'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:35 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:35 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:35 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Deleted volume successfully. Sep 28 17:29:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d0870d37-0e68-4b59-815d-68e43211c77c tempest-VolumeAndVolumeTypeFromImageTest-206748514 None] Lock "cinder-5b594c22-56d7-4555-9b62-1e37e0216514-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (bbd6fbcb-cb16-4be3-b07c-b39f9e41cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63211cc6-bc7e-4927-946a-80dd3c30999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63211cc6-bc7e-4927-946a-80dd3c30999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416134624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bffb8a0-ac21-4c03-a6bf-959cf03b0eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:40Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457808b0-b827-4b96-af98-d7e7cfacaa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457808b0-b827-4b96-af98-d7e7cfacaa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8964b2e4-5b29-4202-94de-7b4607207963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8964b2e4-5b29-4202-94de-7b4607207963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bffb8a0-ac21-4c03-a6bf-959cf03b0eef', 'volume_name': 'volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1090ef-74e3-4cfb-8efe-2fc8df66efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1090ef-74e3-4cfb-8efe-2fc8df66efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87298054-b4d5-4cc3-9b46-78a36dc15973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume 4bffb8a0-ac21-4c03-a6bf-959cf03b0eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef', 'volume_size': 1} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416134624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bffb8a0-ac21-4c03-a6bf-959cf03b0eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:40Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume 4bffb8a0-ac21-4c03-a6bf-959cf03b0eef {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:40 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:40 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef 1073741824 Sep 28 17:29:40 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:41 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef 1073741824" returned: 0 in 0.487s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:41 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef Sep 28 17:29:41 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:41 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" returned: 0 in 0.298s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87298054-b4d5-4cc3-9b46-78a36dc15973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41798c40-7b8e-43d3-ab09-7d639d449ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef (4bffb8a0-ac21-4c03-a6bf-959cf03b0eef): created successfully Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41798c40-7b8e-43d3-ab09-7d639d449ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (bbd6fbcb-cb16-4be3-b07c-b39f9e41cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a3fe5799-8b74-4aab-aec0-eb35a23630b3 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:42 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:42 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (85467285-b436-4563-ad7f-36410bf61120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ddc951-13b3-467f-bbaa-be0dbcfa4364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ddc951-13b3-467f-bbaa-be0dbcfa4364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274772865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7e7295-25d4-4de6-b09d-9b3425e906af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:43Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa96dc61-ff96-496b-96a9-f7669e468811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa96dc61-ff96-496b-96a9-f7669e468811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680fcc6-c49c-41ec-b203-e67e6d98d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4680fcc6-c49c-41ec-b203-e67e6d98d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7e7295-25d4-4de6-b09d-9b3425e906af', 'volume_name': 'volume-8c7e7295-25d4-4de6-b09d-9b3425e906af', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebec1e8d-e12c-41ac-9f71-9f81e841b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebec1e8d-e12c-41ac-9f71-9f81e841b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7a39e3-5b78-439a-9563-bd2c0ea4a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume 8c7e7295-25d4-4de6-b09d-9b3425e906af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7e7295-25d4-4de6-b09d-9b3425e906af', 'volume_size': 1} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274772865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7e7295-25d4-4de6-b09d-9b3425e906af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:43Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume 8c7e7295-25d4-4de6-b09d-9b3425e906af {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:43 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:43 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af 1073741824 Sep 28 17:29:43 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (5d4f5189-a6b1-465b-b826-1360fd9e7f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec1220-495b-4727-b592-fff7c1ecfdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec1220-495b-4727-b592-fff7c1ecfdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894687472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a853b0-1b83-4317-b979-bb5acce707e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:43Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c463b459-bf0a-44a3-9ab1-98bc3fcd23f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c463b459-bf0a-44a3-9ab1-98bc3fcd23f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55008d4-06e2-4cb3-b30e-72628812dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55008d4-06e2-4cb3-b30e-72628812dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a853b0-1b83-4317-b979-bb5acce707e8', 'volume_name': 'volume-45a853b0-1b83-4317-b979-bb5acce707e8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97785620-cc42-4fef-8af4-cbe0af948705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97785620-cc42-4fef-8af4-cbe0af948705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0713abd-821a-4adf-bf97-61fc30aa4ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume 45a853b0-1b83-4317-b979-bb5acce707e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a853b0-1b83-4317-b979-bb5acce707e8', 'volume_size': 1} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:43 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af 1073741824" returned: 0 in 0.596s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:43 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af Sep 28 17:29:43 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (ec30a85e-ecb9-4a87-8ced-f062b9d86963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffa2cfc-d24f-4b83-a77c-b24797e6f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffa2cfc-d24f-4b83-a77c-b24797e6f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489778356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9646cd5-f56a-4f1b-86c8-81da41730a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22779e01-7964-4608-8955-b5ceb3c43431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22779e01-7964-4608-8955-b5ceb3c43431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983c2ecf-4eb7-4da0-a725-ec11f4c05221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983c2ecf-4eb7-4da0-a725-ec11f4c05221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9646cd5-f56a-4f1b-86c8-81da41730a66', 'volume_name': 'volume-f9646cd5-f56a-4f1b-86c8-81da41730a66', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe11b9c8-c687-47c3-bb62-d69e0d056914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe11b9c8-c687-47c3-bb62-d69e0d056914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca598c9d-304e-4bf9-a935-5e0854049360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume f9646cd5-f56a-4f1b-86c8-81da41730a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9646cd5-f56a-4f1b-86c8-81da41730a66', 'volume_size': 1} Sep 28 17:29:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894687472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a853b0-1b83-4317-b979-bb5acce707e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:43Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume 45a853b0-1b83-4317-b979-bb5acce707e8 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7a39e3-5b78-439a-9563-bd2c0ea4a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7e7295-25d4-4de6-b09d-9b3425e906af', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 1073741824 Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b65371-1be9-4316-aace-e02f6605e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-8c7e7295-25d4-4de6-b09d-9b3425e906af (8c7e7295-25d4-4de6-b09d-9b3425e906af): created successfully Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b65371-1be9-4316-aace-e02f6605e736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (85467285-b436-4563-ad7f-36410bf61120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c752df90-1dde-46e0-8f8d-1580af5b9215 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (fecd61bf-9735-4474-98c6-0867285eba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106a129-849c-4b21-ac7b-6341b5feddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106a129-849c-4b21-ac7b-6341b5feddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633672739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb8feb9-dcf7-4c65-a95f-7113fa07e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6bda5a-0b1c-4132-a882-2703eb44a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6bda5a-0b1c-4132-a882-2703eb44a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057937f8-885b-428b-898a-ec82227647d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057937f8-885b-428b-898a-ec82227647d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb8feb9-dcf7-4c65-a95f-7113fa07e771', 'volume_name': 'volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94eda0d-241b-45f8-bb45-b78f765aa6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94eda0d-241b-45f8-bb45-b78f765aa6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85586c0-4131-407f-8a7a-ae2f4142ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume 8bb8feb9-dcf7-4c65-a95f-7113fa07e771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771', 'volume_size': 1} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 1073741824" returned: 0 in 0.550s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:44 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 Sep 28 17:29:44 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (c5cc94d7-50f0-4113-a22e-f07830d760cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ceace5-f855-4d5c-9a0c-ecddf79d322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ceace5-f855-4d5c-9a0c-ecddf79d322b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814577510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cddc1fc-6448-421d-9bd7-3b59feb4c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:45Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c2809f-7c0d-4842-b80f-770edd5dddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c2809f-7c0d-4842-b80f-770edd5dddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39d0ba-8a02-46bb-bf88-90d182f4b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39d0ba-8a02-46bb-bf88-90d182f4b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cddc1fc-6448-421d-9bd7-3b59feb4c7a4', 'volume_name': 'volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417fddbc-b538-499a-a4d6-1fbc92a22e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417fddbc-b538-499a-a4d6-1fbc92a22e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037f0b3e-54a5-40cd-a824-83d763ec3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume 2cddc1fc-6448-421d-9bd7-3b59feb4c7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4', 'volume_size': 1} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-489778356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9646cd5-f56a-4f1b-86c8-81da41730a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume f9646cd5-f56a-4f1b-86c8-81da41730a66 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0713abd-821a-4adf-bf97-61fc30aa4ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a853b0-1b83-4317-b979-bb5acce707e8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 1073741824 Sep 28 17:29:44 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413900a2-df83-4ebb-8d80-10558832b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-45a853b0-1b83-4317-b979-bb5acce707e8 (45a853b0-1b83-4317-b979-bb5acce707e8): created successfully Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413900a2-df83-4ebb-8d80-10558832b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (5d4f5189-a6b1-465b-b826-1360fd9e7f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-541cc247-bb40-4558-bd7b-b4fec760ce40 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:45 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 1073741824" returned: 0 in 0.475s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:45 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 Sep 28 17:29:45 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:45 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66" returned: 0 in 0.273s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-633672739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb8feb9-dcf7-4c65-a95f-7113fa07e771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:44Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume 8bb8feb9-dcf7-4c65-a95f-7113fa07e771 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:45 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca598c9d-304e-4bf9-a935-5e0854049360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9646cd5-f56a-4f1b-86c8-81da41730a66', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:45 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 1073741824 Sep 28 17:29:45 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad13b1fd-a2b2-4597-b104-1e92061d654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 (f9646cd5-f56a-4f1b-86c8-81da41730a66): created successfully Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad13b1fd-a2b2-4597-b104-1e92061d654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (ec30a85e-ecb9-4a87-8ced-f062b9d86963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9c43587a-6b30-4165-9235-8a7e522158fd tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:46 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 1073741824" returned: 0 in 0.497s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:46 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 Sep 28 17:29:46 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:46 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" returned: 0 in 0.258s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1814577510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cddc1fc-6448-421d-9bd7-3b59feb4c7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0827b5a454e14db4934daf9bca9fa6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:45Z,use_quota=True,user_id='24cef59a5696482f80ac6f3842f3a0df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Creating volume 2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:46 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85586c0-4131-407f-8a7a-ae2f4142ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:46 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 1073741824 Sep 28 17:29:46 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb44c7-7efc-42ee-951c-211065edcbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 (8bb8feb9-dcf7-4c65-a95f-7113fa07e771): created successfully Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb44c7-7efc-42ee-951c-211065edcbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (fecd61bf-9735-4474-98c6-0867285eba8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d954a0e7-3123-4ad2-bb74-5ba7204e7aad tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:46 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 1073741824" returned: 0 in 0.442s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:47 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 Sep 28 17:29:47 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:47 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" returned: 0 in 0.275s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037f0b3e-54a5-40cd-a824-83d763ec3c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6cb25-6102-4ee2-af9d-a6f2887f122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Volume volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 (2cddc1fc-6448-421d-9bd7-3b59feb4c7a4): created successfully Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6cb25-6102-4ee2-af9d-a6f2887f122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Flow 'volume_create_manager' (c5cc94d7-50f0-4113-a22e-f07830d760cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-76635f40-51e8-46f3-bb47-d4dd7b871332 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created volume successfully. Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da36e36-e47a-4311-ac18-30af47abca46]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 Sep 28 17:29:48 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:48 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4 Sep 28 17:29:48 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:48 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" returned: 0 in 0.250s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4" released by "delete_volume" :: held 0.665s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['c70ca4bc-2a9b-4fd2-b9ed-ca900ae993b9', '7c1c6f63-4bc9-4812-9264-a1d011075698', '2a3d57c2-ef97-479b-aea3-f56c242027eb', '614a1665-cf70-42d2-a710-6d009ab240bd'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:49 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.278s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-8bb8feb9-dcf7-4c65-a95f-7113fa07e771-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-723eb54b-fc49-441a-b15e-d2c23608c998 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-2cddc1fc-6448-421d-9bd7-3b59feb4c7a4-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-8bb8feb9-dcf7-4c65-a95f-7113fa07e771-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f614e47-a849-4600-a20d-655008ffee7b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 Sep 28 17:29:49 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:49 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" returned: 0 in 0.365s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:49 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771 Sep 28 17:29:49 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:50 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" returned: 0 in 0.245s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-8bb8feb9-dcf7-4c65-a95f-7113fa07e771" released by "delete_volume" :: held 0.648s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['8f5918de-28ba-4ff4-8be2-baccdc72b3ac', 'ef54f092-3527-4cb0-8b03-681163716283', 'a03c337c-23ab-4a95-bd17-4769c3980260', '81dad25f-128a-44ad-820e-95553eb2cd67'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:50 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:50 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:50 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.244s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de05c59e-ae0d-44bc-acfb-243887d44038 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-8bb8feb9-dcf7-4c65-a95f-7113fa07e771-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-f9646cd5-f56a-4f1b-86c8-81da41730a66-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-f9646cd5-f56a-4f1b-86c8-81da41730a66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-f9646cd5-f56a-4f1b-86c8-81da41730a66" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-f9646cd5-f56a-4f1b-86c8-81da41730a66" acquired by "delete_volume" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d42c73-1160-46d5-b1a1-acc7c8e2ab55]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:50 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 Sep 28 17:29:50 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66" returned: 0 in 0.351s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66 Sep 28 17:29:51 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f9646cd5-f56a-4f1b-86c8-81da41730a66" returned: 0 in 0.245s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-f9646cd5-f56a-4f1b-86c8-81da41730a66" released by "delete_volume" :: held 0.641s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['9cb36507-22e9-4cd1-aad9-7e8a223de717', '1c8c39b7-00d2-4f38-b586-a14082d4e268', '36efe690-0ff8-4eb1-aac6-8bacbb518c52', 'a3eb224c-bd31-4fcf-88e5-ad3d6a9d1bcf'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:51 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:51 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:51 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0b0f351c-2d97-4bd7-b5a0-b164ac74884c tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-f9646cd5-f56a-4f1b-86c8-81da41730a66-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-45a853b0-1b83-4317-b979-bb5acce707e8-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-45a853b0-1b83-4317-b979-bb5acce707e8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-45a853b0-1b83-4317-b979-bb5acce707e8" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-45a853b0-1b83-4317-b979-bb5acce707e8" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464731b-e738-4575-a054-093a7b2640e9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 Sep 28 17:29:52 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8" returned: 0 in 0.360s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8 Sep 28 17:29:52 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-45a853b0-1b83-4317-b979-bb5acce707e8" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-45a853b0-1b83-4317-b979-bb5acce707e8" released by "delete_volume" :: held 0.669s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['2c66f8a6-2db4-4b83-9083-fd7409d63673', '0aac69c5-1e1a-4e6f-8ab0-8e072e21dd88', '27d9aebe-430c-4453-a96a-b3490cfa6f61', 'bde597a6-e9df-4caa-943b-7f764f55a850'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:52 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:52 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:52 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.285s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:52 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-be5b6b20-1245-404f-a967-180eb88bcb7d tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-45a853b0-1b83-4317-b979-bb5acce707e8-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-8c7e7295-25d4-4de6-b09d-9b3425e906af-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-8c7e7295-25d4-4de6-b09d-9b3425e906af-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-8c7e7295-25d4-4de6-b09d-9b3425e906af" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-8c7e7295-25d4-4de6-b09d-9b3425e906af" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac60f7-3272-49ac-8092-91090054cdd0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:53 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af Sep 28 17:29:53 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:53 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af" returned: 0 in 0.403s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:53 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af Sep 28 17:29:53 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:53 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-8c7e7295-25d4-4de6-b09d-9b3425e906af" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-8c7e7295-25d4-4de6-b09d-9b3425e906af" released by "delete_volume" :: held 0.723s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['39ea21d4-5f52-4ba0-b3de-a28bc9f45202', '4acd2dc8-6b4f-4ae2-a48f-0ba558271ec7', 'a431d818-c329-4841-a7bc-925ed1bae90b', 'b9f3baff-502c-483a-b6dc-3386fd8c356e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:54 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:54 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.294s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "cinder-quobyte-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fbb8bc08-8cb0-4275-91dd-3764e0251c57 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-8c7e7295-25d4-4de6-b09d-9b3425e906af-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec8b93-cb0a-4aaa-b43d-761d8ec74ac1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:54 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef Sep 28 17:29:54 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:54 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" returned: 0 in 0.401s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:54 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef Sep 28 17:29:54 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" returned: 0 in 0.282s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-quobyte-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef" released by "delete_volume" :: held 0.731s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Created reservations ['ddf3d2e3-6cfe-4ee2-8ba9-0ec75863703e', 'ebb0c0f7-9a39-458f-8e63-100df1269ca4', '3722159a-787d-4ec2-b32e-f209f03f2a5a', 'fc6d5cd9-891c-4962-a1c1-704e402f2a4a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:55 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:29:55 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:55 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Deleted volume successfully. Sep 28 17:29:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6dfedf69-8e3a-4c20-a704-376ac24d1314 tempest-CreateVolumesFromSourceVolumeTest-1256514712 None] Lock "cinder-4bffb8a0-ac21-4c03-a6bf-959cf03b0eef-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:05 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=50,cinder:INSERT=25,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:05 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=60,cinder:UPDATE=75,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:07 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:30:07 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:07 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:30:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Flow 'volume_create_manager' (134354ec-f4e9-420b-a90b-f3f8bc5e79f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d94810-0b9c-49eb-8997-cb12150a762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d94810-0b9c-49eb-8997-cb12150a762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467670990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e8709-9c16-4b00-941d-a5b9db87e71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2537a519c90d46fdb23f5e00dc461dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:16Z,use_quota=True,user_id='caedc83b60d24ab3bb5b14123d71045b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e50926-5dcf-4e6e-a603-3eccdb9a4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90e50926-5dcf-4e6e-a603-3eccdb9a4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8ccc0f-d967-4c66-ae9f-43c4586d3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8ccc0f-d967-4c66-ae9f-43c4586d3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3e8709-9c16-4b00-941d-a5b9db87e71f', 'volume_name': 'volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82cf299-8911-40c5-9a05-7cea1046d662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82cf299-8911-40c5-9a05-7cea1046d662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f5b13-b6b3-452d-bfd4-2a5ee9282358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Volume 4c3e8709-9c16-4b00-941d-a5b9db87e71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f', 'volume_size': 1} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1467670990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3e8709-9c16-4b00-941d-a5b9db87e71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2537a519c90d46fdb23f5e00dc461dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:16Z,use_quota=True,user_id='caedc83b60d24ab3bb5b14123d71045b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Creating volume 4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:16 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f 1073741824 Sep 28 17:30:16 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:16 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f 1073741824" returned: 0 in 0.486s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:16 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:16 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:16 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f5b13-b6b3-452d-bfd4-2a5ee9282358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276eb261-beea-4a4f-ab31-e9d896077882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Volume volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f (4c3e8709-9c16-4b00-941d-a5b9db87e71f): created successfully Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276eb261-beea-4a4f-ab31-e9d896077882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Flow 'volume_create_manager' (134354ec-f4e9-420b-a90b-f3f8bc5e79f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-40d56684-42eb-4ddd-badb-009aabf0161c tempest-SnapshotDependencyTests-298153567 None] Created volume successfully. Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Creating offline snapshot dc623665-05bb-47bd-929b-15c6652376fe of volume 4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6cb97-9bf3-417a-a545-c0b8e93e49a3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:18 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:18 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:18 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:18 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe 1G Sep 28 17:30:18 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe 1G" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:19 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:19 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.344s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:19 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe is being set with open permissions: ugo+rw Sep 28 17:30:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:19 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:19 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:20 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.248s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:20 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info Sep 28 17:30:20 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:20 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info" returned: 0 in 0.284s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:20 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info is being set with open permissions: ugo+rw Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:20 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info Sep 28 17:30:20 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:20 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.info" returned: 0 in 0.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:20 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dd6af276-a015-463e-9345-8c928ce43aad tempest-SnapshotDependencyTests-298153567 None] Create snapshot completed successfully Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Flow 'volume_create_manager' (feb2826d-c8bd-49fc-9ac7-78a5947ff356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2268a55-8336-41f8-93d0-13449cd3108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2268a55-8336-41f8-93d0-13449cd3108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2537a519c90d46fdb23f5e00dc461dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc623665-05bb-47bd-929b-15c6652376fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:30:22Z,use_quota=True,user_id='caedc83b60d24ab3bb5b14123d71045b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d87305-4157-4945-b1cd-e46b2fc432c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d87305-4157-4945-b1cd-e46b2fc432c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19bf78f-dd9d-4582-81f3-4679e566e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19bf78f-dd9d-4582-81f3-4679e566e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0', 'volume_name': 'volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0', 'volume_size': 1, 'snapshot_id': 'dc623665-05bb-47bd-929b-15c6652376fe'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f753124a-c4cf-44dc-afc5-9107edbc4ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f753124a-c4cf-44dc-afc5-9107edbc4ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b42e4c-6a27-4a8c-90e0-a49a45ef75af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Volume 6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0', 'volume_size': 1, 'snapshot_id': 'dc623665-05bb-47bd-929b-15c6652376fe'} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Creating volume 6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 from snapshot dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] snapshot: dc623665-05bb-47bd-929b-15c6652376fe, volume: 6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bdbf3a-8660-440e-bf7a-71bcfa4a598c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:22 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:22 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:22 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec3ad1c-fb7b-4a93-9750-5c9cd52194a3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:23 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:23 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.381s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:30:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:23 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 Sep 28 17:30:23 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" returned: 0 in 5.729s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:30:29 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Converted 1024.00 MB image at 178.70 MB/s Sep 28 17:30:29 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 is being set with open permissions: ugo+rw Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:29 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 Sep 28 17:30:29 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:29 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" returned: 0 in 0.232s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" released by "_copy_volume_from_snapshot" :: held 6.797s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" released by "_create_volume_from_snapshot" :: held 6.866s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.886s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b42e4c-6a27-4a8c-90e0-a49a45ef75af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0', 'volume_size': 1, 'snapshot_id': 'dc623665-05bb-47bd-929b-15c6652376fe'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a579e85e-9656-42b9-8c47-bd0168dbf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:30:29 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Volume volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 (6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0): created successfully Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a579e85e-9656-42b9-8c47-bd0168dbf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Flow 'volume_create_manager' (feb2826d-c8bd-49fc-9ac7-78a5947ff356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:30:29 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-44ea940d-cefc-4900-91bb-87df48d2ca4e tempest-SnapshotDependencyTests-298153567 None] Created volume successfully. Sep 28 17:30:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-dc623665-05bb-47bd-929b-15c6652376fe-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-dc623665-05bb-47bd-929b-15c6652376fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Deleting offline snapshot dc623665-05bb-47bd-929b-15c6652376fe of volume 4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] snapshot_file for this snap is: volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8bde5-61c2-4d7e-94bc-1721ad5053ad]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:30 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:30 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:30 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.372s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[806695cd-d2cd-4406-9d6a-275f20396a02]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:30 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:30 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:30 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.508s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:31 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.326s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:31 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe Sep 28 17:30:31 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:31 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f.dc623665-05bb-47bd-929b-15c6652376fe" returned: 0 in 0.243s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-dc623665-05bb-47bd-929b-15c6652376fe" released by "_delete_snapshot" :: held 1.555s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" released by "delete_snapshot" :: held 1.579s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Created reservations ['e54d450e-9cc2-4daf-867c-6f06383c40bd', 'faf10323-c788-4ad2-a223-ee245faf52fe', '912e11bd-a57b-463c-9ab6-23be6505697f', '5a5bb54e-8cc8-4d1a-b8e8-7c9261106ec1'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Delete snapshot completed successfully. Sep 28 17:30:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-592f82a2-0294-4e7a-a8a3-91815b688d08 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-dc623665-05bb-47bd-929b-15c6652376fe-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-4c3e8709-9c16-4b00-941d-a5b9db87e71f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-4c3e8709-9c16-4b00-941d-a5b9db87e71f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c13179-163f-4e39-b7b5-ecf9742154d0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:32 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:32 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.360s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:32 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f Sep 28 17:30:32 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:32 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4c3e8709-9c16-4b00-941d-a5b9db87e71f" returned: 0 in 0.241s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-4c3e8709-9c16-4b00-941d-a5b9db87e71f" released by "delete_volume" :: held 0.662s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:32 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Created reservations ['3ce3e1f2-f86b-43e0-a342-98963eba676d', 'f4cb555b-4d6c-458a-9059-4f6110cec9cd', '9264436f-a144-427d-bc94-a4fe52015a13', 'd5b2da31-a1c5-4f92-aa2a-1ff4a5737e84'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:33 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:30:33 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:33 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.260s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Deleted volume successfully. Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9d5e79ab-42d3-4951-9ce6-52371dd28541 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-4c3e8709-9c16-4b00-941d-a5b9db87e71f-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d88dd97-e133-455c-8534-ec38940b4c95]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:33 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 Sep 28 17:30:33 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:33 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" returned: 0 in 0.394s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:33 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0 Sep 28 17:30:33 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:34 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" returned: 0 in 0.251s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-quobyte-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0" released by "delete_volume" :: held 0.693s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Created reservations ['1b1aa78d-4fa6-4eb3-8bf7-98c2a5fa9a08', 'e1aac7e5-47c9-4f3a-bbce-0316363123bc', '864d115d-3f7e-4470-bce4-847e9925386c', '3a78d268-9fcb-4a17-9aac-4bf26445b532'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:30:34 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:30:34 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:30:34 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.258s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:30:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Deleted volume successfully. Sep 28 17:30:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fd66b7a6-7a11-45d2-aacd-64ae7b32dc88 tempest-SnapshotDependencyTests-298153567 None] Lock "cinder-6af0b4e0-5a36-4773-b9b4-7da0e1bfb3c0-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:30:44 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:30:44 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=23,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Flow 'volume_create_manager' (1070d4dc-3616-4443-9e41-0cb7cd5b58b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828941ab-3ac4-415e-aec3-72c6eac2e0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (72a9148a-72de-48bf-9ac1-1e5269db2a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ba00c-d587-4859-a3f6-59609290c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828941ab-3ac4-415e-aec3-72c6eac2e0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2057875607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7f563-e7f1-4f28-a8e1-77592a4a9f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b2fa91c33545309328459793c0cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:01Z,use_quota=True,user_id='0d0f6fa996ed4a71b1857e7df0949a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d048dc-bc86-46a8-bcbd-7db5237522fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d048dc-bc86-46a8-bcbd-7db5237522fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3bd3d9-04cf-48ca-b5bc-6a3e149a6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3bd3d9-04cf-48ca-b5bc-6a3e149a6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c7f563-e7f1-4f28-a8e1-77592a4a9f22', 'volume_name': 'volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584a9950-cb61-4b2d-a2b5-5e6843e64a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584a9950-cb61-4b2d-a2b5-5e6843e64a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cf0c12-e508-485c-bb51-33664a27c227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Volume 53c7f563-e7f1-4f28-a8e1-77592a4a9f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22', 'volume_size': 1} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2057875607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7f563-e7f1-4f28-a8e1-77592a4a9f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b2fa91c33545309328459793c0cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:01Z,use_quota=True,user_id='0d0f6fa996ed4a71b1857e7df0949a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Creating volume 53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:01 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0ba00c-d587-4859-a3f6-59609290c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210560401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71090a80-38a9-41c8-b783-0161d3517978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:01Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 1073741824 Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dced1f5f-911a-41ab-83e1-847b08c326d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dced1f5f-911a-41ab-83e1-847b08c326d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bd4328-598f-494c-9896-bc5dd922b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bd4328-598f-494c-9896-bc5dd922b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71090a80-38a9-41c8-b783-0161d3517978', 'volume_name': 'volume-71090a80-38a9-41c8-b783-0161d3517978', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eb7318-a2cb-412a-af00-0c736d7575f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eb7318-a2cb-412a-af00-0c736d7575f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b62e415-e184-4d3d-ba34-2375375a9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume 71090a80-38a9-41c8-b783-0161d3517978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71090a80-38a9-41c8-b783-0161d3517978', 'volume_size': 1} Sep 28 17:31:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:02 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 1073741824" returned: 0 in 0.616s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:02 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:02 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:02 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.280s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210560401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71090a80-38a9-41c8-b783-0161d3517978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:01Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume 71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:02 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cf0c12-e508-485c-bb51-33664a27c227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be257215-344b-41e3-891e-b1baca5d6c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:02 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 1073741824 Sep 28 17:31:02 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:02 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Volume volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 (53c7f563-e7f1-4f28-a8e1-77592a4a9f22): created successfully Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be257215-344b-41e3-891e-b1baca5d6c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Flow 'volume_create_manager' (1070d4dc-3616-4443-9e41-0cb7cd5b58b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:02 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9fa3de54-608f-4c09-be1c-81abed2fca6d tempest-VolumeDependencyTests-1963791602 None] Created volume successfully. Sep 28 17:31:02 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 1073741824" returned: 0 in 0.613s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:03 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 Sep 28 17:31:03 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:03 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b62e415-e184-4d3d-ba34-2375375a9601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71090a80-38a9-41c8-b783-0161d3517978', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafc4412-fe77-4415-b94c-afb3b7c56d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:03 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-71090a80-38a9-41c8-b783-0161d3517978 (71090a80-38a9-41c8-b783-0161d3517978): created successfully Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafc4412-fe77-4415-b94c-afb3b7c56d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (72a9148a-72de-48bf-9ac1-1e5269db2a1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Creating offline snapshot 77713acd-b0c3-42ef-90ba-57eed4f2977e of volume 53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:31:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8858e38a-4391-4e1f-a481-f4cb58b8109b tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c32a5-f601-4c04-99e3-db7202dc257c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:03 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:03 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:03 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.442s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:03 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e 1G Sep 28 17:31:03 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:04 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e 1G" returned: 0 in 0.653s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:04 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:04 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Flow 'volume_create_manager' (f8bf0133-7d31-4330-9204-bfcc373feaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12966ce-2151-47e2-845f-4b78c7d8a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12966ce-2151-47e2-845f-4b78c7d8a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f2e8c9-0885-4370-8f91-dd8d039a1028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deab8b2fce9d4faeaac9690a4213e72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:05Z,use_quota=True,user_id='2d3f148f130e4bbe84629df5b283e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5322416a-b04e-4743-90ac-f42a1ed223c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5322416a-b04e-4743-90ac-f42a1ed223c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7143a66d-3c78-4e34-bb7a-f3079abbe8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:31:04 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.350s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:04 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e is being set with open permissions: ugo+rw Sep 28 17:31:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:04 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:04 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7143a66d-3c78-4e34-bb7a-f3079abbe8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4f2e8c9-0885-4370-8f91-dd8d039a1028', 'volume_name': 'volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028', 'volume_size': 1, 'image_id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73cc00e02a06d7288871a679e9d7b0a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'deab8b2fce9d4faeaac9690a4213e72b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a833b930be9b4c67a3cfb1642a20d666f3aef94c9060d8f5dd22b4c111095a21b005473cfb8b8d2d07a4f311b0e82e22a9de4452f3f86eeabede47c1d2362b4', 'id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39d078-a853-4439-8f61-20aa23e311df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39d078-a853-4439-8f61-20aa23e311df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c67a91-2ed3-4956-bacc-d83508d491a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Volume a4f2e8c9-0885-4370-8f91-dd8d039a1028: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028', 'volume_size': 1, 'image_id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73cc00e02a06d7288871a679e9d7b0a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'deab8b2fce9d4faeaac9690a4213e72b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a833b930be9b4c67a3cfb1642a20d666f3aef94c9060d8f5dd22b4c111095a21b005473cfb8b8d2d07a4f311b0e82e22a9de4452f3f86eeabede47c1d2362b4', 'id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c/file', 'properties': {}}, 'image_service': } Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Trying to clone a4f2e8c9-0885-4370-8f91-dd8d039a1028 from image 8fb54d2a-851a-4b92-ab10-d5df01213f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:31:05 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:31:05 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.317s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fcec1d-bec4-40cf-8007-a99606db6511]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:05 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info Sep 28 17:31:05 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:05 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info" returned: 0 in 0.333s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:05 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info is being set with open permissions: ugo+rw Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:05 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info Sep 28 17:31:05 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:05 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:05 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Flow 'volume_create_manager' (bbe16cf5-7b97-4f7d-b44d-ff7bf0d3be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b2b4ae-fef4-4e8e-b357-56e2e03c767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b2b4ae-fef4-4e8e-b357-56e2e03c767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197668f-b36c-455d-8650-1d662bbce0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd8d1e42335419584b97b4bab81e032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:06Z,use_quota=True,user_id='5c5e47343bdb4971b46e3a1db5e04232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1030998-0c83-4a1d-8a51-01e505785c8c),volume_type_id=b1030998-0c83-4a1d-8a51-01e505785c8c)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2474222-caef-494d-9d5a-5deebcf5d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2474222-caef-494d-9d5a-5deebcf5d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c40bd-7f5f-4d15-8691-3253a4824096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG cinder.image.glance [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Creating Keystone auth plugin from conf {{(pid=86929) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:31:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.info" returned: 0 in 0.309s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.583s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.518s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating offline snapshot ef58abea-bfbe-4372-beec-36197ca748ad of volume 71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:31:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-80346ec1-3fea-4fbc-b216-d8160f6bdf58 tempest-VolumeDependencyTests-1963791602 None] Create snapshot completed successfully Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e930400-cd52-449d-883e-58a21d07d3f1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Temporary image 8fb54d2a-851a-4b92-ab10-d5df01213f4c is fetched for user 2d3f148f130e4bbe84629df5b283e27b. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:31:06 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 Sep 28 17:31:06 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4117f3bd-432d-4864-8f7f-e5d19d06b80d]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153c40bd-7f5f-4d15-8691-3253a4824096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5197668f-b36c-455d-8650-1d662bbce0dc', 'volume_name': 'volume-5197668f-b36c-455d-8650-1d662bbce0dc', 'volume_size': 1, 'image_id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc56cec8922ab0772bf017faaf25346b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd8d1e42335419584b97b4bab81e032', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c973d915d122098e3ccc82428f7e9e5c4a2b06f5e1965b62d1716d4ee34e123ad3afa2db554d8b3b02406e5ae8d8b07ec2ffb0ba3889d791a011ab1f08fe8ff', 'id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2205b7a4-fdbf-471f-b142-baf49913981d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01f0c50-88b7-4b5f-bbcf-03031d3dd709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01f0c50-88b7-4b5f-bbcf-03031d3dd709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978189a4-8370-415b-8577-0a45837edc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:06 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Volume 5197668f-b36c-455d-8650-1d662bbce0dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5197668f-b36c-455d-8650-1d662bbce0dc', 'volume_size': 1, 'image_id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc56cec8922ab0772bf017faaf25346b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd8d1e42335419584b97b4bab81e032', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c973d915d122098e3ccc82428f7e9e5c4a2b06f5e1965b62d1716d4ee34e123ad3afa2db554d8b3b02406e5ae8d8b07ec2ffb0ba3889d791a011ab1f08fe8ff', 'id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2205b7a4-fdbf-471f-b142-baf49913981d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Trying to clone 5197668f-b36c-455d-8650-1d662bbce0dc from image 2205b7a4-fdbf-471f-b142-baf49913981d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}]). {{(pid=86929) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:31:06 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:06 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:31:06 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209d9fc-b5da-4d21-aed4-a4ce93b87c5c]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978" returned: 0 in 0.444s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad 1G Sep 28 17:31:06 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:06 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:06 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:06 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:06 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:07 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:07 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad 1G" returned: 0 in 0.680s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71090a80-38a9-41c8-b783-0161d3517978 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71090a80-38a9-41c8-b783-0161d3517978 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad Sep 28 17:31:07 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Temporary image 2205b7a4-fdbf-471f-b142-baf49913981d is fetched for user 5c5e47343bdb4971b46e3a1db5e04232. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6ec4a2-7cc9-4ef1-a690-0a426b19f6b4]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Flow 'volume_create_manager' (2dba762f-8037-489f-99f9-e9014d50cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe806c3-4188-41b1-b95c-80a15254ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe806c3-4188-41b1-b95c-80a15254ef63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2130492131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503174ff-63f5-4da8-b97f-37dba314d21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70b2fa91c33545309328459793c0cd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77713acd-b0c3-42ef-90ba-57eed4f2977e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:07Z,use_quota=True,user_id='0d0f6fa996ed4a71b1857e7df0949a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6cb1e6-ef5c-4f2d-b714-e57e6f9c020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6cb1e6-ef5c-4f2d-b714-e57e6f9c020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e01abb-fc38-4ca2-a3c5-0e3aecee13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:07 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e01abb-fc38-4ca2-a3c5-0e3aecee13f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '503174ff-63f5-4da8-b97f-37dba314d21d', 'volume_name': 'volume-503174ff-63f5-4da8-b97f-37dba314d21d', 'volume_size': 1, 'snapshot_id': '77713acd-b0c3-42ef-90ba-57eed4f2977e'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:07 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc01ec6-1c74-49fe-8223-1d53ecbc5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc01ec6-1c74-49fe-8223-1d53ecbc5f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d055d8-7590-4df6-aa70-ce6fb01bf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:07 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Volume 503174ff-63f5-4da8-b97f-37dba314d21d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-503174ff-63f5-4da8-b97f-37dba314d21d', 'volume_size': 1, 'snapshot_id': '77713acd-b0c3-42ef-90ba-57eed4f2977e'} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:07 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:07 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71090a80-38a9-41c8-b783-0161d3517978 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad" returned: 0 in 0.391s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad is being set with open permissions: ugo+rw Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad Sep 28 17:31:07 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.309s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:31:07 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:07 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:07 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:07 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info Sep 28 17:31:07 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:08 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:08 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info" returned: 0 in 0.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:08 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info is being set with open permissions: ugo+rw Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:08 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info Sep 28 17:31:08 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:08 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.info" returned: 0 in 0.296s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.452s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f2e8c9-0885-4370-8f91-dd8d039a1028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deab8b2fce9d4faeaac9690a4213e72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:05Z,use_quota=True,user_id='2d3f148f130e4bbe84629df5b283e27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Creating volume a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:08 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:08 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1073741824 Sep 28 17:31:08 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-91d84486-96bd-4690-9472-36cb046765a9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Create snapshot completed successfully Sep 28 17:31:09 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1073741824" returned: 0 in 0.536s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:09 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:09 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (839356db-7c2b-4913-9412-48a012225f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904169fd-af48-4296-aee6-bab5368b7d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:09 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904169fd-af48-4296-aee6-bab5368b7d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878985906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4d9ec3-619b-4195-ba64-da143c6fe169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:09Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab88951-4542-4199-b0ac-2e124338074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab88951-4542-4199-b0ac-2e124338074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2def005-526a-454d-ac91-cb80a1c14287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2def005-526a-454d-ac91-cb80a1c14287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4d9ec3-619b-4195-ba64-da143c6fe169', 'volume_name': 'volume-6c4d9ec3-619b-4195-ba64-da143c6fe169', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe842b8-0d3f-488c-8225-a3c3d93107be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe842b8-0d3f-488c-8225-a3c3d93107be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f9fc0-3b7c-4565-8aa2-7cca81426bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume 6c4d9ec3-619b-4195-ba64-da143c6fe169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4d9ec3-619b-4195-ba64-da143c6fe169', 'volume_size': 1} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028" returned: 0 in 0.400s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.962s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e-503174ff-63f5-4da8-b97f-37dba314d21d" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e-503174ff-63f5-4da8-b97f-37dba314d21d" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Creating volume 503174ff-63f5-4da8-b97f-37dba314d21d from snapshot 77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Attempting download of 8fb54d2a-851a-4b92-ab10-d5df01213f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}])) to volume a4f2e8c9-0885-4370-8f91-dd8d039a1028. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] snapshot: 77713acd-b0c3-42ef-90ba-57eed4f2977e, volume: 503174ff-63f5-4da8-b97f-37dba314d21d, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ca915-0b5b-4882-9344-e0ceb652c8c3]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d5925-0c05-49c6-abbd-493e9af38b04]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:09 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d Sep 28 17:31:09 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:09 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:09 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:10 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d" returned: 0 in 0.350s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:10 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (e81d591b-a9b1-418a-8f22-a54cebf375bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74dda69-7de2-4031-81d9-bfb0b3ae0e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:10 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d Sep 28 17:31:10 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.473s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e74dda69-7de2-4031-81d9-bfb0b3ae0e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008588721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1977a4-2f64-48a3-a0da-d9fedb0d41d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:10Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eb2534-a2a9-40dd-81a6-d65af0771e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43eb2534-a2a9-40dd-81a6-d65af0771e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5aa20b-b73e-4f15-8af2-232250b09fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5aa20b-b73e-4f15-8af2-232250b09fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1977a4-2f64-48a3-a0da-d9fedb0d41d3', 'volume_name': 'volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7196fd-2be3-4cb1-80ec-0aff91073c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7196fd-2be3-4cb1-80ec-0aff91073c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85f9668-222a-4fe1-944e-8a662a01fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume 3f1977a4-2f64-48a3-a0da-d9fedb0d41d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3', 'volume_size': 1} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1bf7c-11c8-4536-a5c6-3d8e6a0aa295]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:10 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:10 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:10 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d" returned: 1 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8fb54d2a-851a-4b92-ab10-d5df01213f4c_n_cii10d' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d58196b-b7a4-4a8b-9e97-585b73539895]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:10 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:10 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:10 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:10 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d Sep 28 17:31:10 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:10 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:10 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD Sep 28 17:31:10 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:11 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:11 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] 8fb54d2a-851a-4b92-ab10-d5df01213f4c was raw, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:31:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:11 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 Sep 28 17:31:11 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:12 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028" returned: 0 in 0.942s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8fb54d2a-851a-4b92-ab10-d5df01213f4c_unhclm0odevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:31:12 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:12 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1G Sep 28 17:31:12 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:12 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 1G" returned: 0 in 0.586s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Downloaded image 8fb54d2a-851a-4b92-ab10-d5df01213f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}])) to volume a4f2e8c9-0885-4370-8f91-dd8d039a1028 successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Temporary image 8fb54d2a-851a-4b92-ab10-d5df01213f4c for user 2d3f148f130e4bbe84629df5b283e27b is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:31:12 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Marking volume a4f2e8c9-0885-4370-8f91-dd8d039a1028 as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:31:13 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Copying metadata from image 8fb54d2a-851a-4b92-ab10-d5df01213f4c to a4f2e8c9-0885-4370-8f91-dd8d039a1028. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:31:13 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Creating volume glance metadata for volume a4f2e8c9-0885-4370-8f91-dd8d039a1028 backed by image 8fb54d2a-851a-4b92-ab10-d5df01213f4c with: {'image_id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '73cc00e02a06d7288871a679e9d7b0a7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:31:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c67a91-2ed3-4956-bacc-d83508d491a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028', 'volume_size': 1, 'image_id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73cc00e02a06d7288871a679e9d7b0a7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'deab8b2fce9d4faeaac9690a4213e72b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a833b930be9b4c67a3cfb1642a20d666f3aef94c9060d8f5dd22b4c111095a21b005473cfb8b8d2d07a4f311b0e82e22a9de4452f3f86eeabede47c1d2362b4', 'id': '8fb54d2a-851a-4b92-ab10-d5df01213f4c', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8fb54d2a-851a-4b92-ab10-d5df01213f4c/file', 'properties': {}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84476704-22d3-4c74-84f8-3e00d61d7d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Volume volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 (a4f2e8c9-0885-4370-8f91-dd8d039a1028): created successfully Sep 28 17:31:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84476704-22d3-4c74-84f8-3e00d61d7d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Flow 'volume_create_manager' (f8bf0133-7d31-4330-9204-bfcc373feaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:16 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (c8fa77a4-b7e6-4a3c-bf7d-603045784386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1f83f3-2fd9-42d0-93cc-15aa4b54504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1f83f3-2fd9-42d0-93cc-15aa4b54504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376674421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d4867b-8176-4759-b08e-87280b6976ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:15Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a98e19-c416-40e2-a3c6-2db0420036b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a98e19-c416-40e2-a3c6-2db0420036b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab92f1a-6db7-4504-8966-484509639cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab92f1a-6db7-4504-8966-484509639cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d4867b-8176-4759-b08e-87280b6976ae', 'volume_name': 'volume-42d4867b-8176-4759-b08e-87280b6976ae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b951f8a-e6a1-4d0d-86b0-288d875d508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b951f8a-e6a1-4d0d-86b0-288d875d508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26374abe-825e-46c2-b2df-c6e989b21d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume 42d4867b-8176-4759-b08e-87280b6976ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d4867b-8176-4759-b08e-87280b6976ae', 'volume_size': 1} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-68cc01f5-9f69-4901-8839-c56f5204055d tempest-VolumeImageDependencyTests-1050730577 None] Created volume successfully. Sep 28 17:31:17 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d" returned: 0 in 6.640s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Converted 1024.00 MB image at 154.19 MB/s Sep 28 17:31:17 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d is being set with open permissions: ugo+rw Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:17 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d Sep 28 17:31:17 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (4da3c215-ae72-41de-a35c-c51c3792a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975407ee-d4b8-461d-ae68-1c6e4d83b259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975407ee-d4b8-461d-ae68-1c6e4d83b259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029634156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:17Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7412dc-0b6f-4ad6-9bd7-a8cf4fc699f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7412dc-0b6f-4ad6-9bd7-a8cf4fc699f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed73727-a60a-4eb3-8cfb-e20686d2b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed73727-a60a-4eb3-8cfb-e20686d2b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f', 'volume_name': 'volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e49012-7346-4ea7-a921-b237cfe2f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e49012-7346-4ea7-a921-b237cfe2f995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d48becc-7684-47a9-8086-ded73194d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f', 'volume_size': 1} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d" returned: 0 in 0.281s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" released by "_copy_volume_from_snapshot" :: held 7.988s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e-503174ff-63f5-4da8-b97f-37dba314d21d" released by "_create_volume_from_snapshot" :: held 8.102s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.149s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.503s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197668f-b36c-455d-8650-1d662bbce0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd8d1e42335419584b97b4bab81e032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:06Z,use_quota=True,user_id='5c5e47343bdb4971b46e3a1db5e04232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1030998-0c83-4a1d-8a51-01e505785c8c),volume_type_id=b1030998-0c83-4a1d-8a51-01e505785c8c)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Creating volume 5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:17 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1073741824 Sep 28 17:31:17 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d055d8-7590-4df6-aa70-ce6fb01bf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503174ff-63f5-4da8-b97f-37dba314d21d', 'volume_size': 1, 'snapshot_id': '77713acd-b0c3-42ef-90ba-57eed4f2977e'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805adcd7-5973-4bb6-b559-b35945e02450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Volume volume-503174ff-63f5-4da8-b97f-37dba314d21d (503174ff-63f5-4da8-b97f-37dba314d21d): created successfully Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805adcd7-5973-4bb6-b559-b35945e02450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Flow 'volume_create_manager' (2dba762f-8037-489f-99f9-e9014d50cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (49763a60-bc59-43d4-bf40-d08aa8c240fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac19935-3680-420f-874b-c8f6c84152e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f6c49afc-068e-4abe-b1a4-d126dcd5148b tempest-VolumeDependencyTests-1963791602 None] Created volume successfully. Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac19935-3680-420f-874b-c8f6c84152e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-494832343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bf9f19-9222-4e69-b78f-541a06694fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:18Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a53093-0769-4a82-a139-901da3b665cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a53093-0769-4a82-a139-901da3b665cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb3f75-363d-49c8-aee2-f9b398c55605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb3f75-363d-49c8-aee2-f9b398c55605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bf9f19-9222-4e69-b78f-541a06694fb0', 'volume_name': 'volume-37bf9f19-9222-4e69-b78f-541a06694fb0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6fece6-8b66-4468-abce-90e7af3827e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6fece6-8b66-4468-abce-90e7af3827e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9c1b48-4ca3-4a6e-8c2d-5382121bb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:17 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume 37bf9f19-9222-4e69-b78f-541a06694fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bf9f19-9222-4e69-b78f-541a06694fb0', 'volume_size': 1} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Acquiring lock "cinder-a4f2e8c9-0885-4370-8f91-dd8d039a1028-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "cinder-a4f2e8c9-0885-4370-8f91-dd8d039a1028-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:17 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Acquiring lock "cinder-quobyte-a4f2e8c9-0885-4370-8f91-dd8d039a1028" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "cinder-quobyte-a4f2e8c9-0885-4370-8f91-dd8d039a1028" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b97e855-bad0-4b1f-af1d-af839666df5a]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 Sep 28 17:31:18 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1073741824" returned: 0 in 0.533s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc Sep 28 17:31:18 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-77713acd-b0c3-42ef-90ba-57eed4f2977e-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-77713acd-b0c3-42ef-90ba-57eed4f2977e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:18 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028" returned: 0 in 0.461s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Deleting offline snapshot 77713acd-b0c3-42ef-90ba-57eed4f2977e of volume 53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:31:18 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028 Sep 28 17:31:18 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] snapshot_file for this snap is: volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:31:18 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc" returned: 0 in 0.290s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a73d2-531e-48f7-9afd-3b2dac640f30]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.033s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-878985906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4d9ec3-619b-4195-ba64-da143c6fe169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:09Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume 6c4d9ec3-619b-4195-ba64-da143c6fe169 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:18 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 1073741824 Sep 28 17:31:18 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Attempting download of 2205b7a4-fdbf-471f-b142-baf49913981d ((None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}])) to volume 5197668f-b36c-455d-8650-1d662bbce0dc. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9681e9-9711-4f8a-8ab2-d7c419e3b657]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:18 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:18 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a4f2e8c9-0885-4370-8f91-dd8d039a1028" returned: 0 in 0.308s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "cinder-quobyte-a4f2e8c9-0885-4370-8f91-dd8d039a1028" released by "delete_volume" :: held 0.820s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Created reservations ['76094060-fa5d-4acd-a32d-f800b0fb9d79', '17eb9911-171d-4e7b-84d4-1bc8dfe46137', 'ed4d8b09-db78-424c-b094-bff3d702105a', '9ad2f681-eb65-43e8-88aa-2a9d6323755f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:18 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3 Sep 28 17:31:18 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:19 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.527s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d1b4d-fc93-426f-a5f9-97573f5b207f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 1073741824" returned: 0 in 0.628s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3" returned: 0 in 0.499s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:19 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 Sep 28 17:31:19 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.450s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:19 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3 Sep 28 17:31:19 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Deleted volume successfully. Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d8a5c36d-72ab-4dbc-8c59-b4901ee45d3e tempest-VolumeImageDependencyTests-1050730577 None] Lock "cinder-a4f2e8c9-0885-4370-8f91-dd8d039a1028-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:19 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169" returned: 0 in 0.459s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.486s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2008588721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1977a4-2f64-48a3-a0da-d9fedb0d41d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:10Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume 3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:19 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:19 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3" returned: 1 in 0.609s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2205b7a4-fdbf-471f-b142-baf49913981d_m1c_2cl3' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88bae8-3907-4335-812f-0c1d087ad2c8]: (4, 'raw') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (001f9fc0-3b7c-4565-8aa2-7cca81426bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4d9ec3-619b-4195-ba64-da143c6fe169', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:19 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 1073741824 Sep 28 17:31:19 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d828108-f585-445d-b9ec-c7fe5304d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:19 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 (6c4d9ec3-619b-4195-ba64-da143c6fe169): created successfully Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d828108-f585-445d-b9ec-c7fe5304d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (839356db-7c2b-4913-9412-48a012225f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5ff63b7a-66bb-4f1b-b604-a40800b316d9 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:19 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.812s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:20 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:20 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 1073741824" returned: 0 in 0.612s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD Sep 28 17:31:20 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 Sep 28 17:31:20 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e Sep 28 17:31:20 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD" returned: 1 in 0.405s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] 2205b7a4-fdbf-471f-b142-baf49913981d was raw, converting to qcow2 {{(pid=86929) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc Sep 28 17:31:20 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" returned: 0 in 0.349s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.640s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376674421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d4867b-8176-4759-b08e-87280b6976ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:15Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume 42d4867b-8176-4759-b08e-87280b6976ae {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:20 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:20 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22.77713acd-b0c3-42ef-90ba-57eed4f2977e" returned: 0 in 0.374s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:20 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae 1073741824 Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b85f9668-222a-4fe1-944e-8a662a01fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:20 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496d8a1f-0fd8-4802-8aa6-2d63891e9a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-77713acd-b0c3-42ef-90ba-57eed4f2977e" released by "_delete_snapshot" :: held 2.434s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:20 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 (3f1977a4-2f64-48a3-a0da-d9fedb0d41d3): created successfully Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496d8a1f-0fd8-4802-8aa6-2d63891e9a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:20 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (e81d591b-a9b1-418a-8f22-a54cebf375bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" released by "delete_snapshot" :: held 2.501s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d42941e5-f8df-49a6-b326-51e33d0ce3d7 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Created reservations ['034fbe03-a2e3-4bd8-ac4d-e1337e03c510', 'a360c7b7-dd56-4511-9a26-3225d5774160', '18f62cf0-e74d-4104-b4c1-d954a729d72b', 'b7bd88a7-7755-4e00-9671-0b04302e114e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Delete snapshot completed successfully. Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ba0906e3-6966-4065-b107-fb0e9a9395e9 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-77713acd-b0c3-42ef-90ba-57eed4f2977e-delete_snapshot" released by "delete_snapshot" :: held 2.838s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:21 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc" returned: 0 in 0.710s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2205b7a4-fdbf-471f-b142-baf49913981d_xfhbhfo0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:21 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1G Sep 28 17:31:21 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:21 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae 1073741824" returned: 0 in 0.629s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:21 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae Sep 28 17:31:21 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-53c7f563-e7f1-4f28-a8e1-77592a4a9f22-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-53c7f563-e7f1-4f28-a8e1-77592a4a9f22-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:21 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae" returned: 0 in 0.371s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:21 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.375s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2029634156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:17Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[942abb8e-8009-463c-b35d-07aa230ca115]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:21 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f 1073741824 Sep 28 17:31:21 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26374abe-825e-46c2-b2df-c6e989b21d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d4867b-8176-4759-b08e-87280b6976ae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d333e4-dc01-4c8b-b5f2-be971a15f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc 1G" returned: 0 in 0.513s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Downloaded image 2205b7a4-fdbf-471f-b142-baf49913981d ((None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}])) to volume 5197668f-b36c-455d-8650-1d662bbce0dc successfully. {{(pid=86929) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Temporary image 2205b7a4-fdbf-471f-b142-baf49913981d for user 5c5e47343bdb4971b46e3a1db5e04232 is deleted. {{(pid=86929) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.volume_utils [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Marking volume 5197668f-b36c-455d-8650-1d662bbce0dc as bootable. {{(pid=86929) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-42d4867b-8176-4759-b08e-87280b6976ae (42d4867b-8176-4759-b08e-87280b6976ae): created successfully Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d333e4-dc01-4c8b-b5f2-be971a15f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (c8fa77a4-b7e6-4a3c-bf7d-603045784386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Copying metadata from image 2205b7a4-fdbf-471f-b142-baf49913981d to 5197668f-b36c-455d-8650-1d662bbce0dc. {{(pid=86929) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:31:21 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Creating volume glance metadata for volume 5197668f-b36c-455d-8650-1d662bbce0dc backed by image 2205b7a4-fdbf-471f-b142-baf49913981d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fc56cec8922ab0772bf017faaf25346b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86929) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:31:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1df269bc-4a31-4cea-bb6a-b6c569cbeb06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:22 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:22 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978189a4-8370-415b-8577-0a45837edc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5197668f-b36c-455d-8650-1d662bbce0dc', 'volume_size': 1, 'image_id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2205b7a4-fdbf-471f-b142-baf49913981d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc56cec8922ab0772bf017faaf25346b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7fd8d1e42335419584b97b4bab81e032', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1c973d915d122098e3ccc82428f7e9e5c4a2b06f5e1965b62d1716d4ee34e123ad3afa2db554d8b3b02406e5ae8d8b07ec2ffb0ba3889d791a011ab1f08fe8ff', 'id': '2205b7a4-fdbf-471f-b142-baf49913981d', 'created_at': datetime.datetime(2026, 9, 28, 15, 31, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 31, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2205b7a4-fdbf-471f-b142-baf49913981d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e5cfff-71e0-4cb3-9c9a-aa967cf16f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Volume volume-5197668f-b36c-455d-8650-1d662bbce0dc (5197668f-b36c-455d-8650-1d662bbce0dc): created successfully Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e5cfff-71e0-4cb3-9c9a-aa967cf16f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Flow 'volume_create_manager' (bbe16cf5-7b97-4f7d-b44d-ff7bf0d3be4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f84fea2d-b2c6-40b1-aa7b-16b999e8e63e tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Created volume successfully. Sep 28 17:31:22 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.513s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Acquiring lock "cinder-5197668f-b36c-455d-8650-1d662bbce0dc-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:22 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22 Sep 28 17:31:22 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "cinder-5197668f-b36c-455d-8650-1d662bbce0dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:22 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f 1073741824" returned: 0 in 0.627s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Acquiring lock "cinder-quobyte-5197668f-b36c-455d-8650-1d662bbce0dc" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "cinder-quobyte-5197668f-b36c-455d-8650-1d662bbce0dc" acquired by "delete_volume" :: waited 0.045s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:22 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f Sep 28 17:31:22 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f25139-fc16-4dd1-9ad0-19876305bce1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:22 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc Sep 28 17:31:22 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:22 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" returned: 0 in 0.337s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-53c7f563-e7f1-4f28-a8e1-77592a4a9f22" released by "delete_volume" :: held 0.947s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Created reservations ['150c56f1-66a7-496a-a5aa-d087b336a4a9', 'f5d872bc-752c-43ae-9ddf-8a61b7b062d2', 'e24542ce-f2de-42d3-812c-62def6503385', 'a9260957-3df8-4bdf-adbf-ab32989bfcf5'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:22 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" returned: 0 in 0.326s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.977s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-494832343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bf9f19-9222-4e69-b78f-541a06694fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c38c5748fb4451823356aabb9d3100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:18Z,use_quota=True,user_id='59df5ed4233d497fb4cc2026ec26bf0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Creating volume 37bf9f19-9222-4e69-b78f-541a06694fb0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:22 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:22 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 1073741824 Sep 28 17:31:22 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d48becc-7684-47a9-8086-ded73194d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9533a2-e97f-4c90-9b2a-7b12889edc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:23 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f (bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f): created successfully Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9533a2-e97f-4c90-9b2a-7b12889edc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (4da3c215-ae72-41de-a35c-c51c3792a441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:23 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9eec9cf5-bf67-4e48-9893-d53614778b06 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:23 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:23 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:23 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:23 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc Sep 28 17:31:23 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:23 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.349s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:23 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Deleted volume successfully. Sep 28 17:31:23 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6167ea63-940e-42f8-86aa-6d74e7d80857 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-53c7f563-e7f1-4f28-a8e1-77592a4a9f22-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5197668f-b36c-455d-8650-1d662bbce0dc" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "cinder-quobyte-5197668f-b36c-455d-8650-1d662bbce0dc" released by "delete_volume" :: held 0.892s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:23 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 1073741824" returned: 0 in 0.604s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Created reservations ['7bf7e1f5-5f71-46e4-9562-04bb0a484cc3', '0ff94bdf-e729-44f0-821b-150fb11589f7', '535ea089-3f3d-4960-8f14-8849cb49e31b', '02a6b061-2513-4c4a-bba6-277e1f531814'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:23 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 Sep 28 17:31:23 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:23 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:23 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:23 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9c1b48-4ca3-4a6e-8c2d-5382121bb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bf9f19-9222-4e69-b78f-541a06694fb0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53286a64-8708-433e-9ff0-287782eef811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:23 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.336s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:23 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Deleted volume successfully. Sep 28 17:31:24 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Volume volume-37bf9f19-9222-4e69-b78f-541a06694fb0 (37bf9f19-9222-4e69-b78f-541a06694fb0): created successfully Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53286a64-8708-433e-9ff0-287782eef811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Flow 'volume_create_manager' (49763a60-bc59-43d4-bf40-d08aa8c240fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-503174ff-63f5-4da8-b97f-37dba314d21d-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-30892a14-8525-45aa-b7b6-ae1e57e21944 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created volume successfully. Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0e2a0739-c22f-43bd-8bbe-fd40180bb3ce tempest-VolumeAndVolumeTypeFromImageTest-482714478 None] Lock "cinder-5197668f-b36c-455d-8650-1d662bbce0dc-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-503174ff-63f5-4da8-b97f-37dba314d21d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e99a88-de9e-4ad7-aae0-64bea1a6af56]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:24 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d Sep 28 17:31:24 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:24 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d" returned: 0 in 0.429s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:24 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d Sep 28 17:31:24 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-37bf9f19-9222-4e69-b78f-541a06694fb0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-37bf9f19-9222-4e69-b78f-541a06694fb0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-37bf9f19-9222-4e69-b78f-541a06694fb0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-37bf9f19-9222-4e69-b78f-541a06694fb0" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c63f5-5534-4d93-ac4a-364462efdb12]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:24 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-503174ff-63f5-4da8-b97f-37dba314d21d" returned: 0 in 0.359s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-quobyte-503174ff-63f5-4da8-b97f-37dba314d21d" released by "delete_volume" :: held 0.870s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Created reservations ['50b72872-fb77-48d3-9760-dec5e4a57cd0', 'a8544b57-6683-4c7d-98ed-4196b685b0a8', 'a5c4c6fc-733b-496a-a8ab-ac361436cb49', '6dfac9c5-d74c-4fe0-b4e9-bae24a3c421a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:25 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 Sep 28 17:31:25 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:25 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:25 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:25 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0" returned: 0 in 0.606s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:25 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0 Sep 28 17:31:25 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:25 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.470s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Deleted volume successfully. Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-668b4d21-53a9-4762-9fe9-194b65985ab7 tempest-VolumeDependencyTests-1963791602 None] Lock "cinder-503174ff-63f5-4da8-b97f-37dba314d21d-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:25 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37bf9f19-9222-4e69-b78f-541a06694fb0" returned: 0 in 0.422s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-37bf9f19-9222-4e69-b78f-541a06694fb0" released by "delete_volume" :: held 1.101s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['3e699161-9352-4ae6-9776-0a0e276b51ee', '71315abd-33c3-41e3-bebf-78f0659c72a6', '4347d46a-beb3-4367-b241-775ce5b6f745', '07b8d5fa-9de8-4c76-ae27-a06f47a25988'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:26 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:26 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:26 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.351s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5a51ebb3-ba8c-41e9-9d63-6ebc1a139ec0 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-37bf9f19-9222-4e69-b78f-541a06694fb0-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c7b605-9815-470a-b09d-33bbc70472a9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:27 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f Sep 28 17:31:27 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:27 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" returned: 0 in 0.492s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:27 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f Sep 28 17:31:27 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:28 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" returned: 0 in 0.303s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f" released by "delete_volume" :: held 0.870s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['c05f37fd-3596-4014-97d1-8767446ab9f2', '46bf49ef-ab74-4df4-8f8b-cfbb3bcc64ec', '5f3f359f-fb41-48c6-a150-e8feda6d7638', '6e90b17f-00cb-47b9-be76-d8ec4dd5c4ac'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:28 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:28 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-42d4867b-8176-4759-b08e-87280b6976ae-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-42d4867b-8176-4759-b08e-87280b6976ae-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-42d4867b-8176-4759-b08e-87280b6976ae" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-42d4867b-8176-4759-b08e-87280b6976ae" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd5284-28af-47fd-850d-c11a73d8423d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:28 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-98f72b8a-5799-45ec-ba30-ad155fa2e344 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-bd9b0656-5c96-4dbf-a8ec-c5ae20bed78f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:28 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae Sep 28 17:31:28 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:29 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae" returned: 0 in 0.441s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:29 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae Sep 28 17:31:29 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:29 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-42d4867b-8176-4759-b08e-87280b6976ae" returned: 0 in 0.329s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-42d4867b-8176-4759-b08e-87280b6976ae" released by "delete_volume" :: held 0.845s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['b40553e3-35ea-4084-b772-c84453525cb6', '5fd5ae65-90cf-475d-87cc-ef5153b0ebbb', '70f69db7-ca25-454f-880a-98ee0b1cb946', '6a560669-3ce7-4e32-aa01-5cf822333e35'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:29 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:29 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:30 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.444s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-d14ed66a-2b0e-47c2-bac2-918d79668b6e tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-42d4867b-8176-4759-b08e-87280b6976ae-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d45940-68c1-41c1-9c68-9f17320f1bbb]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:30 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 Sep 28 17:31:30 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Flow 'volume_create_manager' (4761c197-f012-46e4-a598-9026fe2cb289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb814652-04a3-4bb9-87f6-ceeb0d537354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb814652-04a3-4bb9-87f6-ceeb0d537354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db05effac64549aae82c87d2a514a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:30Z,use_quota=True,user_id='2ef306276acc47708b389440c92e8a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2913c52-16c5-4da4-996a-42fd4918cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2913c52-16c5-4da4-996a-42fd4918cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f5f9e1-398f-44b2-9f7b-0336f98b860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f5f9e1-398f-44b2-9f7b-0336f98b860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b', 'volume_name': 'volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84511c7-5900-4293-bb53-d77dc61e0ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84511c7-5900-4293-bb53-d77dc61e0ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb871cc-4a97-4c5b-97fd-6e2b1ac3da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Volume 0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b', 'volume_size': 1} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db05effac64549aae82c87d2a514a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:30Z,use_quota=True,user_id='2ef306276acc47708b389440c92e8a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Creating volume 0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:30 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:30 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b 1073741824 Sep 28 17:31:30 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (719a1556-52f5-445b-b910-ee04f11aef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06fc0a0-9f2d-4e59-9375-9e3ba2bd77d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06fc0a0-9f2d-4e59-9375-9e3ba2bd77d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757060780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194da242-c582-4d20-8b53-20516cb3cc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:30Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82d62db-40ec-4bc2-8307-c830a6eda4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82d62db-40ec-4bc2-8307-c830a6eda4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89111bdc-8859-4bae-b39a-c7e072355bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89111bdc-8859-4bae-b39a-c7e072355bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194da242-c582-4d20-8b53-20516cb3cc26', 'volume_name': 'volume-194da242-c582-4d20-8b53-20516cb3cc26', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423cbba1-6067-4c3c-a980-7db1dd3b1ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423cbba1-6067-4c3c-a980-7db1dd3b1ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:30 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2267eb-7ba5-4453-bc6e-f65c3cac94b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:30 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Volume 194da242-c582-4d20-8b53-20516cb3cc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194da242-c582-4d20-8b53-20516cb3cc26', 'volume_size': 1} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" returned: 0 in 0.624s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:30 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3 Sep 28 17:31:30 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (16361150-fd2c-4e14-be73-ea091d9057ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bdd755-963c-4d29-9620-4879f5686201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bdd755-963c-4d29-9620-4879f5686201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-916403643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fa11ae-5f25-4ca4-89f6-1f8d19d57be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:31Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130126d0-aac3-46b1-aca7-7ba469b48691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130126d0-aac3-46b1-aca7-7ba469b48691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8b675b-0eaf-4429-840c-25355d513c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8b675b-0eaf-4429-840c-25355d513c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05fa11ae-5f25-4ca4-89f6-1f8d19d57be1', 'volume_name': 'volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6152c532-0535-407c-9c12-f9df7324b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6152c532-0535-407c-9c12-f9df7324b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c454fc-3e42-4a1a-9f40-fc83cf6bfad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Volume 05fa11ae-5f25-4ca4-89f6-1f8d19d57be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1', 'volume_size': 1} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:31 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b 1073741824" returned: 0 in 0.688s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" returned: 0 in 0.410s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3" released by "delete_volume" :: held 1.126s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (347c8b5c-c903-4d3a-8068-1698bd28d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6c556b-f40f-418b-a2b7-b24d64085317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf6c556b-f40f-418b-a2b7-b24d64085317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945291706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ae6455-da46-4438-9c1d-8a453f535be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:31Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97daf690-4d75-4aba-8b46-47fff4cd7745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97daf690-4d75-4aba-8b46-47fff4cd7745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf9804-3eb5-45d1-9bb1-74520b1eba31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b Sep 28 17:31:31 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf9804-3eb5-45d1-9bb1-74520b1eba31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ae6455-da46-4438-9c1d-8a453f535be6', 'volume_name': 'volume-37ae6455-da46-4438-9c1d-8a453f535be6', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b0112e-b08b-470d-a2d1-09f87374a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b0112e-b08b-470d-a2d1-09f87374a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae682c1-94d8-4044-a7a3-279540ee1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Volume 37ae6455-da46-4438-9c1d-8a453f535be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ae6455-da46-4438-9c1d-8a453f535be6', 'volume_size': 1} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['f97b7053-c531-42c9-ac99-935899843dcc', '0282fa33-caeb-453e-aefa-4fb098ae0eda', '2ad4cbf0-c32e-468b-874a-fa5066f17218', '515e4ae6-1861-4d92-927c-bdb3b29f1921'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:31 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1757060780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194da242-c582-4d20-8b53-20516cb3cc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:30Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Creating volume 194da242-c582-4d20-8b53-20516cb3cc26 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:31 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb871cc-4a97-4c5b-97fd-6e2b1ac3da8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 1073741824 Sep 28 17:31:31 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5882027-97e4-4f9f-bda0-9d8342cc8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Volume volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b (0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b): created successfully Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5882027-97e4-4f9f-bda0-9d8342cc8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Flow 'volume_create_manager' (4761c197-f012-46e4-a598-9026fe2cb289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:32 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6b7043d9-4e3e-40c7-9876-7bde89596481 tempest-CinderUnicodeTest-1848518517 None] Created volume successfully. Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (12e44bfd-dd20-4a63-a8c7-4baeb2efdc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bea5655-6058-4746-94fe-27fc8848b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bea5655-6058-4746-94fe-27fc8848b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971675621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3846592a-f9fd-495d-8484-cef074118cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:32Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47653d0b-6e75-4fb3-b2a8-92daa886fd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47653d0b-6e75-4fb3-b2a8-92daa886fd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1422fe2-7bec-4268-a0ce-749efc5c117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1422fe2-7bec-4268-a0ce-749efc5c117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3846592a-f9fd-495d-8484-cef074118cf5', 'volume_name': 'volume-3846592a-f9fd-495d-8484-cef074118cf5', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79dfdb01-ab69-46d1-8309-a408d083aa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79dfdb01-ab69-46d1-8309-a408d083aa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06facf85-c109-4038-ac23-accd5aaedfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Volume 3846592a-f9fd-495d-8484-cef074118cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3846592a-f9fd-495d-8484-cef074118cf5', 'volume_size': 1} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.492s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:32 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-75b97c07-3807-4039-a81f-a24814eafba6 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-3f1977a4-2f64-48a3-a0da-d9fedb0d41d3-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-6c4d9ec3-619b-4195-ba64-da143c6fe169-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-6c4d9ec3-619b-4195-ba64-da143c6fe169-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-6c4d9ec3-619b-4195-ba64-da143c6fe169" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:32 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 1073741824" returned: 0 in 0.802s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-6c4d9ec3-619b-4195-ba64-da143c6fe169" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b1733-da57-4278-b877-5d8d185e1edc]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (360db500-9052-4f94-9c2f-b02b4c239d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1a4d1f-3cf9-40f7-99fc-6219dc16ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1a4d1f-3cf9-40f7-99fc-6219dc16ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1671404121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1fe308-3f9f-4349-8202-b8eb63a26c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:33Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd056819-a151-4cf7-9af7-eed9ca376f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd056819-a151-4cf7-9af7-eed9ca376f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55153c-c61b-438a-b111-1773ee84309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f55153c-c61b-438a-b111-1773ee84309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1fe308-3f9f-4349-8202-b8eb63a26c22', 'volume_name': 'volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9fe79b-5679-4a4d-b8c4-e56cdf591494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9fe79b-5679-4a4d-b8c4-e56cdf591494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3e5d48-3aa9-4f9e-9d65-7f35724cb43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Volume 3b1fe308-3f9f-4349-8202-b8eb63a26c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22', 'volume_size': 1} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:32 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 Sep 28 17:31:32 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:32 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 Sep 28 17:31:32 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169" returned: 0 in 0.494s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-916403643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fa11ae-5f25-4ca4-89f6-1f8d19d57be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:31Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Creating volume 05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:33 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169 Sep 28 17:31:33 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2267eb-7ba5-4453-bc6e-f65c3cac94b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194da242-c582-4d20-8b53-20516cb3cc26', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f883429f-bf2b-42ae-8f9b-8c7cd19ce1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 1073741824 Sep 28 17:31:33 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Volume volume-194da242-c582-4d20-8b53-20516cb3cc26 (194da242-c582-4d20-8b53-20516cb3cc26): created successfully Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f883429f-bf2b-42ae-8f9b-8c7cd19ce1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (719a1556-52f5-445b-b910-ee04f11aef9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Flow 'volume_create_manager' (7c2947c6-6f12-4e60-8914-5f35ea7c57d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24596f6-6a5c-411b-93f4-facee782727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fd4633d2-0117-478d-8d4f-c7609f60df2e tempest-CreateVolumesFromImageTest-110761290 None] Created volume successfully. Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24596f6-6a5c-411b-93f4-facee782727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1992108146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79baceae-abfe-4083-afb1-d21a10cc5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db05effac64549aae82c87d2a514a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:33Z,use_quota=True,user_id='2ef306276acc47708b389440c92e8a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359f5878-547f-4871-a0f7-67adb3c9ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359f5878-547f-4871-a0f7-67adb3c9ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986a271e-2155-40aa-84d5-735eb11e102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986a271e-2155-40aa-84d5-735eb11e102e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79baceae-abfe-4083-afb1-d21a10cc5030', 'volume_name': 'volume-79baceae-abfe-4083-afb1-d21a10cc5030', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af679d3-25b1-4d30-a830-dfa4ab30866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af679d3-25b1-4d30-a830-dfa4ab30866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e042f525-b948-45e1-b9c0-f62cce67e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Volume 79baceae-abfe-4083-afb1-d21a10cc5030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79baceae-abfe-4083-afb1-d21a10cc5030', 'volume_size': 1} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6c4d9ec3-619b-4195-ba64-da143c6fe169" returned: 0 in 0.320s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-6c4d9ec3-619b-4195-ba64-da143c6fe169" released by "delete_volume" :: held 0.878s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['75e0c555-3d06-4c67-ac3e-a7977e24cc3c', '876d1caf-264a-4e36-be26-5b50b8495e28', '6912db8b-eaf3-4ee6-b430-e51f8eae8507', 'b2539dd6-503d-435e-83eb-5de9fb12b64c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:33 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-ef58abea-bfbe-4372-beec-36197ca748ad-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-ef58abea-bfbe-4372-beec-36197ca748ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-ef58abea-bfbe-4372-beec-36197ca748ad" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-ef58abea-bfbe-4372-beec-36197ca748ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleting offline snapshot ef58abea-bfbe-4372-beec-36197ca748ad of volume 71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] snapshot_file for this snap is: volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aef4dd-57d6-4c7d-947e-9f6a35a69169]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 1073741824" returned: 0 in 0.658s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:33 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 Sep 28 17:31:33 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:34 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad Sep 28 17:31:34 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:34 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-de3d6549-702a-4f41-87c8-acb815fd0c47 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-6c4d9ec3-619b-4195-ba64-da143c6fe169-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:34 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" returned: 0 in 0.327s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945291706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ae6455-da46-4438-9c1d-8a453f535be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:31Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Creating volume 37ae6455-da46-4438-9c1d-8a453f535be6 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:34 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c454fc-3e42-4a1a-9f40-fc83cf6bfad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4d7ba8-f8fa-4c11-b51b-a0371c4e2899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:34 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 1073741824 Sep 28 17:31:34 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:34 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Volume volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 (05fa11ae-5f25-4ca4-89f6-1f8d19d57be1): created successfully Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4d7ba8-f8fa-4c11-b51b-a0371c4e2899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (16361150-fd2c-4e14-be73-ea091d9057ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4ff8f795-a393-4e03-b95b-d16746e2593f tempest-CreateVolumesFromImageTest-110761290 None] Created volume successfully. Sep 28 17:31:34 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad" returned: 0 in 0.539s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71090a80-38a9-41c8-b783-0161d3517978(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39208d2-56f3-4f0f-871d-9a0147151c2c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:34 devstack sudo[108823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 Sep 28 17:31:34 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:34 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 1073741824" returned: 0 in 0.542s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:34 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978" returned: 0 in 0.439s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:34 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 Sep 28 17:31:34 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:34 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad Sep 28 17:31:34 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:35 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.970s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971675621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3846592a-f9fd-495d-8484-cef074118cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:32Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Creating volume 3846592a-f9fd-495d-8484-cef074118cf5 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:35 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae682c1-94d8-4044-a7a3-279540ee1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ae6455-da46-4438-9c1d-8a453f535be6', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:35 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 1073741824 Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171b7f19-8e61-48bb-94c1-decaf97a4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:35 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Volume volume-37ae6455-da46-4438-9c1d-8a453f535be6 (37ae6455-da46-4438-9c1d-8a453f535be6): created successfully Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171b7f19-8e61-48bb-94c1-decaf97a4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (347c8b5c-c903-4d3a-8068-1698bd28d904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-bb920d8a-b778-4411-b7f3-5b7cd07dd1b7 tempest-CreateVolumesFromImageTest-110761290 None] Created volume successfully. Sep 28 17:31:35 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad" returned: 0 in 0.449s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:35 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad Sep 28 17:31:35 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:35 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978.ef58abea-bfbe-4372-beec-36197ca748ad" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-ef58abea-bfbe-4372-beec-36197ca748ad" released by "_delete_snapshot" :: held 1.943s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:35 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 1073741824" returned: 0 in 0.590s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" released by "delete_snapshot" :: held 1.972s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:35 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 Sep 28 17:31:35 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['03585948-de7d-4d50-92d8-0f79e5d2616e', 'adfb7c2a-f216-460f-aaae-704edf34301e', 'c9f562ab-e946-4d66-9950-2497488a9a1b', 'f521547b-2ed0-44b1-95c0-23e5f9bfaa82'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Delete snapshot completed successfully. Sep 28 17:31:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1dbcd306-7b9f-4472-bc8a-b35563d03147 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-ef58abea-bfbe-4372-beec-36197ca748ad-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:36 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5" returned: 0 in 0.311s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.310s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1671404121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1fe308-3f9f-4349-8202-b8eb63a26c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae042cbd1854beebcb600deef2cf619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:33Z,use_quota=True,user_id='7b691bdf5cff4aa187bc774092c0152d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Creating volume 3b1fe308-3f9f-4349-8202-b8eb63a26c22 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:36 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06facf85-c109-4038-ac23-accd5aaedfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3846592a-f9fd-495d-8484-cef074118cf5', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:36 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 1073741824 Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0ca8d5-cb74-4e60-8e7b-7dfc12b53f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:36 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Volume volume-3846592a-f9fd-495d-8484-cef074118cf5 (3846592a-f9fd-495d-8484-cef074118cf5): created successfully Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0ca8d5-cb74-4e60-8e7b-7dfc12b53f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (12e44bfd-dd20-4a63-a8c7-4baeb2efdc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-74af84c7-9737-425a-8df6-5dbbc221fc33 tempest-CreateVolumesFromImageTest-110761290 None] Created volume successfully. Sep 28 17:31:36 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 1073741824" returned: 0 in 0.514s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:36 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 Sep 28 17:31:36 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-71090a80-38a9-41c8-b783-0161d3517978-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-71090a80-38a9-41c8-b783-0161d3517978-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:37 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1992108146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79baceae-abfe-4083-afb1-d21a10cc5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9db05effac64549aae82c87d2a514a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:33Z,use_quota=True,user_id='2ef306276acc47708b389440c92e8a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Creating volume 79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:37 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" acquired by "delete_volume" :: waited 0.051s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:37 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 1073741824 Sep 28 17:31:37 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3e5d48-3aa9-4f9e-9d65-7f35724cb43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8700f55-4359-4f5f-84cb-833e923ec4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27facc0-dd30-43b0-8aad-5096f300c5c8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:37 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Volume volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 (3b1fe308-3f9f-4349-8202-b8eb63a26c22): created successfully Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8700f55-4359-4f5f-84cb-833e923ec4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Flow 'volume_create_manager' (360db500-9052-4f94-9c2f-b02b4c239d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:37 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ffa439bd-79c2-4b92-b9b9-f3db590fce97 tempest-CreateVolumesFromImageTest-110761290 None] Created volume successfully. Sep 28 17:31:37 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 Sep 28 17:31:37 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:37 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 1073741824" returned: 0 in 0.545s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:37 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978" returned: 0 in 0.488s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:37 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978 Sep 28 17:31:37 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:37 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 Sep 28 17:31:37 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:38 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-71090a80-38a9-41c8-b783-0161d3517978" returned: 0 in 0.286s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:38 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030" returned: 0 in 0.286s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-quobyte-71090a80-38a9-41c8-b783-0161d3517978" released by "delete_volume" :: held 0.870s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e042f525-b948-45e1-b9c0-f62cce67e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79baceae-abfe-4083-afb1-d21a10cc5030', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e3e9fc-a02c-4ad7-975a-520f3a31f700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:38 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Volume volume-79baceae-abfe-4083-afb1-d21a10cc5030 (79baceae-abfe-4083-afb1-d21a10cc5030): created successfully Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e3e9fc-a02c-4ad7-975a-520f3a31f700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Flow 'volume_create_manager' (7c2947c6-6f12-4e60-8914-5f35ea7c57d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dfc5f3ad-fadc-4f6e-ba5d-946165f2beb5 tempest-CinderUnicodeTest-1848518517 None] Created volume successfully. Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Created reservations ['7ce961ee-f9da-4a42-9961-b9cb458e1d0b', 'a66a92d6-1e47-4064-a69e-e87241d0b6d7', '5e993e22-32a5-4119-b3d7-59ada9c93b2a', '6dd8a294-2686-45f7-a67f-32c536ffc890'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:38 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:38 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-3b1fe308-3f9f-4349-8202-b8eb63a26c22-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-3b1fe308-3f9f-4349-8202-b8eb63a26c22-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-quobyte-3b1fe308-3f9f-4349-8202-b8eb63a26c22" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-3b1fe308-3f9f-4349-8202-b8eb63a26c22" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a132ae27-a8d2-4ec0-ab90-1ee3bd812c6f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:38 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.357s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Deleted volume successfully. Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-646a4e26-6f6c-4a95-a929-9e35364d4b11 tempest-CreateVolumesFromSnapshotTest-1668158947 None] Lock "cinder-71090a80-38a9-41c8-b783-0161d3517978-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:38 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 Sep 28 17:31:38 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Creating offline snapshot 441f9798-04a8-4bd4-8300-cf1daa0aae09 of volume 79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755eb39-1145-4bc6-9d90-631bcf1f2a99]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:39 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22" returned: 0 in 0.520s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:39 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22 Sep 28 17:31:39 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:39 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 Sep 28 17:31:39 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:39 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3b1fe308-3f9f-4349-8202-b8eb63a26c22" returned: 0 in 0.360s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-3b1fe308-3f9f-4349-8202-b8eb63a26c22" released by "delete_volume" :: held 0.946s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:39 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030" returned: 0 in 0.502s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:39 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 1G Sep 28 17:31:39 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Created reservations ['a9e2ac1b-3369-47a3-8fbf-6f523fedf907', '95eb9afa-987c-45a4-a3f6-517420b8df66', '17666d47-8f5f-434a-8a83-8c2c313a342c', 'bcd64376-6b98-4a4f-a546-b5b4c240a5ba'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:39 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:39 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:40 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Deleted volume successfully. Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1d978c5c-9fd0-450f-a0be-fdd42d3fb5a4 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-3b1fe308-3f9f-4349-8202-b8eb63a26c22-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:40 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 1G" returned: 0 in 0.686s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79baceae-abfe-4083-afb1-d21a10cc5030 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:40 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79baceae-abfe-4083-afb1-d21a10cc5030 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 Sep 28 17:31:40 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:40 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79baceae-abfe-4083-afb1-d21a10cc5030 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09" returned: 0 in 0.447s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:40 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 is being set with open permissions: ugo+rw Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:40 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 Sep 28 17:31:40 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-3846592a-f9fd-495d-8484-cef074118cf5-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-3846592a-f9fd-495d-8484-cef074118cf5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-quobyte-3846592a-f9fd-495d-8484-cef074118cf5" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-3846592a-f9fd-495d-8484-cef074118cf5" acquired by "delete_volume" :: waited 0.035s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2ecb4-9f77-4963-9cba-d50dc492f3c0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09" returned: 0 in 0.443s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 Sep 28 17:31:41 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info Sep 28 17:31:41 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info is being set with open permissions: ugo+rw Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5" returned: 0 in 0.607s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:41 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info Sep 28 17:31:41 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5 Sep 28 17:31:41 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:41 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.info" returned: 0 in 0.350s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:41 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6465c405-734d-4944-8720-36523d3bfce6 tempest-CinderUnicodeTest-1848518517 None] Create snapshot completed successfully Sep 28 17:31:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3846592a-f9fd-495d-8484-cef074118cf5" returned: 0 in 0.395s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-3846592a-f9fd-495d-8484-cef074118cf5" released by "delete_volume" :: held 1.085s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Created reservations ['e507a11b-d9e5-4ee9-be05-da5bbe685b79', 'fb194de7-89c1-4f88-8c59-153582096200', '13f0d850-30c2-4b2f-a4c0-4b720fa82925', 'f129a891-32df-413a-86f6-e551b6b678e2'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:42 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:42 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-441f9798-04a8-4bd4-8300-cf1daa0aae09-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-441f9798-04a8-4bd4-8300-cf1daa0aae09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-quobyte-441f9798-04a8-4bd4-8300-cf1daa0aae09" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-441f9798-04a8-4bd4-8300-cf1daa0aae09" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Deleting offline snapshot 441f9798-04a8-4bd4-8300-cf1daa0aae09 of volume 79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] snapshot_file for this snap is: volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b523b-d6c3-4745-a602-9676412302e5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:42 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.364s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Deleted volume successfully. Sep 28 17:31:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-ad26c652-2e70-413c-ad53-e097a3ef674b tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-3846592a-f9fd-495d-8484-cef074118cf5-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:42 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 Sep 28 17:31:42 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09" returned: 0 in 0.615s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79baceae-abfe-4083-afb1-d21a10cc5030(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4cc1a-c89d-43ac-8a89-dd44823e2528]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-37ae6455-da46-4438-9c1d-8a453f535be6-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-37ae6455-da46-4438-9c1d-8a453f535be6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-quobyte-37ae6455-da46-4438-9c1d-8a453f535be6" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-37ae6455-da46-4438-9c1d-8a453f535be6" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a7805a-d28b-4df2-95e3-63d07108a81d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 Sep 28 17:31:43 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 Sep 28 17:31:43 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (6ae0f486-0cba-4c3e-a76f-65074105f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7a3159-c367-44d9-a377-74f2fdcea6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7a3159-c367-44d9-a377-74f2fdcea6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496855112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eef721-3525-4925-bfa4-89e78a5425e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:44Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ddb4d3-ee5e-407b-a80c-7af22527ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ddb4d3-ee5e-407b-a80c-7af22527ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca68b123-244e-413b-853d-5f2e34f4e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca68b123-244e-413b-853d-5f2e34f4e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5eef721-3525-4925-bfa4-89e78a5425e2', 'volume_name': 'volume-d5eef721-3525-4925-bfa4-89e78a5425e2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae616eb-ed05-4468-b763-c0f9269773c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae616eb-ed05-4468-b763-c0f9269773c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a46eea-ea0e-455f-b3d8-3f11f7062367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:43 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume d5eef721-3525-4925-bfa4-89e78a5425e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5eef721-3525-4925-bfa4-89e78a5425e2', 'volume_size': 1} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1496855112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eef721-3525-4925-bfa4-89e78a5425e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:44Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume d5eef721-3525-4925-bfa4-89e78a5425e2 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:43 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 1073741824 Sep 28 17:31:43 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:43 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030" returned: 0 in 0.812s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:43 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 Sep 28 17:31:43 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6" returned: 0 in 0.689s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6 Sep 28 17:31:44 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[108962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09 Sep 28 17:31:44 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-37ae6455-da46-4438-9c1d-8a453f535be6" returned: 0 in 0.414s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-37ae6455-da46-4438-9c1d-8a453f535be6" released by "delete_volume" :: held 1.200s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:44 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 1073741824" returned: 0 in 0.757s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Created reservations ['1d2d9946-b562-4a4d-be7b-96a56151334b', '2f98a853-4cc6-4695-8bb4-e4c612f525c3', 'bfc4da98-9fe0-4d08-81a6-ff14be5b28ed', 'bfbbc349-4cc7-49ad-ad12-acb80c8f8109'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 Sep 28 17:31:44 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:44 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030.441f9798-04a8-4bd4-8300-cf1daa0aae09" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:44 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-441f9798-04a8-4bd4-8300-cf1daa0aae09" released by "_delete_snapshot" :: held 2.464s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" released by "delete_snapshot" :: held 2.495s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Created reservations ['121f1d14-e9c9-4134-9225-d527a310a08b', '5fb34a4e-16cb-447d-baac-b6d7f7d08921', '2ac2c24c-6b7e-42c9-90f9-8ca665a7f57f', '6a15bc27-8f9e-4d12-bf22-284908ba1645'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:44 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2" returned: 0 in 0.322s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a46eea-ea0e-455f-b3d8-3f11f7062367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5eef721-3525-4925-bfa4-89e78a5425e2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bceb8935-c449-4f17-89ba-84a58cc90ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-d5eef721-3525-4925-bfa4-89e78a5425e2 (d5eef721-3525-4925-bfa4-89e78a5425e2): created successfully Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bceb8935-c449-4f17-89ba-84a58cc90ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (6ae0f486-0cba-4c3e-a76f-65074105f203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Delete snapshot completed successfully. Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-80ea7611-58b0-49b9-a976-7ab74629b391 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-441f9798-04a8-4bd4-8300-cf1daa0aae09-delete_snapshot" released by "delete_snapshot" :: held 2.741s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2335b2ae-242e-4721-b4f7-481c84a63a68 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:45 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.318s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Deleted volume successfully. Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a70e37e9-602d-4892-8d84-d4182d6dbf5a tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-37ae6455-da46-4438-9c1d-8a453f535be6-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-quobyte-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7eea30-9171-47f7-95f2-9cb906e17f72]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-79baceae-abfe-4083-afb1-d21a10cc5030-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-79baceae-abfe-4083-afb1-d21a10cc5030-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:45 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 Sep 28 17:31:45 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f4960-218c-4cbb-8819-5fd3b7b33ebf]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:45 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 Sep 28 17:31:45 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" returned: 0 in 0.611s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:46 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1 Sep 28 17:31:46 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030" returned: 0 in 0.587s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:46 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030 Sep 28 17:31:46 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (a2228a5d-9825-4b05-a485-d0f0053f6d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7869ad0-ecc9-458a-8dd7-26483425b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7869ad0-ecc9-458a-8dd7-26483425b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811214010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2a8390-8e8c-488d-9d91-a78859560cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:46Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98041eb7-21ea-42c4-a65f-adcf2ffa0f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98041eb7-21ea-42c4-a65f-adcf2ffa0f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec446e0-2e7c-48c2-9126-7659d185dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec446e0-2e7c-48c2-9126-7659d185dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2a8390-8e8c-488d-9d91-a78859560cf0', 'volume_name': 'volume-0c2a8390-8e8c-488d-9d91-a78859560cf0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdf8951-2390-486f-8562-39707a0eba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdf8951-2390-486f-8562-39707a0eba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:46 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0d072b-44e3-4fd5-892d-21fcdec0a52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:46 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume 0c2a8390-8e8c-488d-9d91-a78859560cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2a8390-8e8c-488d-9d91-a78859560cf0', 'volume_size': 1} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811214010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2a8390-8e8c-488d-9d91-a78859560cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:46Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume 0c2a8390-8e8c-488d-9d91-a78859560cf0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:46 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" returned: 0 in 0.542s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:46 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 1073741824 Sep 28 17:31:46 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1" released by "delete_volume" :: held 1.255s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Created reservations ['9692ba75-439e-4757-bd8b-830184006c51', 'c97a0d13-be8e-4ffc-9066-a8002d91271f', '347eef26-1fb0-4af6-bc43-7020f0efcf10', '1f2504a0-d4ca-47f7-bc53-1113d6eed9a0'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:46 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-79baceae-abfe-4083-afb1-d21a10cc5030" returned: 0 in 0.508s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-79baceae-abfe-4083-afb1-d21a10cc5030" released by "delete_volume" :: held 1.204s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Created reservations ['c2b95d31-b41b-46c1-9df5-536ebc00946f', '5e04028f-c888-46d9-9a51-aacc2d6c653e', '3d32f9c5-d31c-4fb8-91c9-361033e931f1', 'd78a3968-f5fc-43fb-bad5-051f0213ff1b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:47 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:47 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (932508c1-3fa6-4a60-8d7f-4ef905405bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fd8538-968f-4fe7-bd94-b6d73c0ab8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fd8538-968f-4fe7-bd94-b6d73c0ab8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1666358414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b63422-c1b8-47ac-bc76-a043c94766a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:47Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009f987d-82dd-44eb-b4a2-684b658e8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009f987d-82dd-44eb-b4a2-684b658e8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc466a5-93a1-443e-8e83-71893ac09aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc466a5-93a1-443e-8e83-71893ac09aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b63422-c1b8-47ac-bc76-a043c94766a2', 'volume_name': 'volume-28b63422-c1b8-47ac-bc76-a043c94766a2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b464880d-dfd4-41e1-bb9d-4a9cb58a9c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b464880d-dfd4-41e1-bb9d-4a9cb58a9c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69915e82-f89e-414a-b2b9-028c907d2652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume 28b63422-c1b8-47ac-bc76-a043c94766a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b63422-c1b8-47ac-bc76-a043c94766a2', 'volume_size': 1} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:47 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:47 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:47 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Deleted volume successfully. Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3a472abe-7b1d-491e-9d2b-1fe045076fa8 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-05fa11ae-5f25-4ca4-89f6-1f8d19d57be1-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:47 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 1073741824" returned: 0 in 0.899s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (80682638-58d7-41f0-a9b3-791dcce1638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b8d0a-540a-445f-bb58-a3337328ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b8d0a-540a-445f-bb58-a3337328ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945216410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97a0b0d-91a6-4d42-9d63-4e336f5c8272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:48Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8d4ec8-6d70-443e-a745-bc05931e72d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8d4ec8-6d70-443e-a745-bc05931e72d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 Sep 28 17:31:47 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cc6d4e-8d52-4a8b-8362-e1e36d87ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cc6d4e-8d52-4a8b-8362-e1e36d87ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97a0b0d-91a6-4d42-9d63-4e336f5c8272', 'volume_name': 'volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4cda14-75d7-4437-bf74-d24e17cd8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4cda14-75d7-4437-bf74-d24e17cd8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcf7d0c-6b74-4527-b4b9-e7dd1a2fc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:47 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume d97a0b0d-91a6-4d42-9d63-4e336f5c8272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272', 'volume_size': 1} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:47 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.537s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:47 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Deleted volume successfully. Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-194da242-c582-4d20-8b53-20516cb3cc26-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-194da242-c582-4d20-8b53-20516cb3cc26-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-957d8ec2-fa6f-48d3-8b6b-222f2aac04d4 tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-79baceae-abfe-4083-afb1-d21a10cc5030-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "cinder-quobyte-194da242-c582-4d20-8b53-20516cb3cc26" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-194da242-c582-4d20-8b53-20516cb3cc26" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5f3ae2-dbc5-4a83-8d9d-2b1e1df50655]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:48 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0" returned: 0 in 0.521s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1666358414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b63422-c1b8-47ac-bc76-a043c94766a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:47Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume 28b63422-c1b8-47ac-bc76-a043c94766a2 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:48 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0d072b-44e3-4fd5-892d-21fcdec0a52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2a8390-8e8c-488d-9d91-a78859560cf0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5c930-df14-403d-a28f-ed118e0e99d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 1073741824 Sep 28 17:31:48 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 (0c2a8390-8e8c-488d-9d91-a78859560cf0): created successfully Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5c930-df14-403d-a28f-ed118e0e99d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (a2228a5d-9825-4b05-a485-d0f0053f6d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:48 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9c3c210a-2fde-412c-8876-112a0fd37e97 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "cinder-quobyte-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (f47c473d-9011-41db-8dbf-4587a3bee9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1324c18-46e3-4e98-8229-e240898e62bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" acquired by "delete_volume" :: waited 0.085s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1324c18-46e3-4e98-8229-e240898e62bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491816867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c467e07c-0447-40d0-9950-83a55ab77041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:48Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e5c8d7-1eb1-4edb-bdb2-1fd802ce0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e5c8d7-1eb1-4edb-bdb2-1fd802ce0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6881988-4529-4771-83ce-5d6133e7e00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6881988-4529-4771-83ce-5d6133e7e00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c467e07c-0447-40d0-9950-83a55ab77041', 'volume_name': 'volume-c467e07c-0447-40d0-9950-83a55ab77041', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca8d58a-4830-4529-ba84-6e7be1684a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca8d58a-4830-4529-ba84-6e7be1684a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b7572-df54-4150-8169-bfdf5f43780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume c467e07c-0447-40d0-9950-83a55ab77041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c467e07c-0447-40d0-9950-83a55ab77041', 'volume_size': 1} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6632435-2117-4270-8eb0-f9fd22d0b464]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:48 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26" returned: 0 in 0.662s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:48 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26 Sep 28 17:31:48 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:48 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b Sep 28 17:31:48 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 1073741824" returned: 0 in 0.932s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (82be741b-1d1d-47e9-9cd8-695ab69d15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf56cda-0a82-42ce-ac3b-2a7e4f3fcb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-194da242-c582-4d20-8b53-20516cb3cc26" returned: 0 in 0.520s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf56cda-0a82-42ce-ac3b-2a7e4f3fcb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811362079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f751be5f-bd4f-45b7-9818-87ad72900f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:49Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce2e1b7-555b-492b-bbf2-e503243a0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce2e1b7-555b-492b-bbf2-e503243a0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c4018-3000-4eb4-b1e5-b3d104d01d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c4018-3000-4eb4-b1e5-b3d104d01d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f751be5f-bd4f-45b7-9818-87ad72900f81', 'volume_name': 'volume-f751be5f-bd4f-45b7-9818-87ad72900f81', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104fc03b-e3a4-4ea8-978f-e120990688bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (104fc03b-e3a4-4ea8-978f-e120990688bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2259891-1fdd-42bc-b84a-51b131903a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume f751be5f-bd4f-45b7-9818-87ad72900f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f751be5f-bd4f-45b7-9818-87ad72900f81', 'volume_size': 1} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" returned: 0 in 0.632s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-quobyte-194da242-c582-4d20-8b53-20516cb3cc26" released by "delete_volume" :: held 1.352s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:49 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b Sep 28 17:31:49 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 Sep 28 17:31:49 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Created reservations ['62e8c4d1-2552-4654-9978-0640e10fb9be', '2f774f46-7f3c-4795-966f-7910c5bbf603', 'b1146a48-c4bb-4006-b99c-45e77d50017a', '1a659a44-38a7-4241-8e0e-ce7133b77967'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:49 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" returned: 0 in 0.290s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-quobyte-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b" released by "delete_volume" :: held 1.074s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Created reservations ['cec1f336-f45d-4c3f-be96-8f398c30c914', '8dfee837-0926-4ae3-8ad5-a53beb851f30', 'f1ca6b42-347a-408d-b80c-a78c6860bee3', 'e60aaa5e-6f04-4b31-acf7-3b99c69a6232'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:49 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2" returned: 0 in 0.374s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1945216410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97a0b0d-91a6-4d42-9d63-4e336f5c8272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:48Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume d97a0b0d-91a6-4d42-9d63-4e336f5c8272 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:49 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69915e82-f89e-414a-b2b9-028c907d2652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b63422-c1b8-47ac-bc76-a043c94766a2', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf276f21-6a9f-4949-9e1a-d6a82f295392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:49 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 1073741824 Sep 28 17:31:49 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-28b63422-c1b8-47ac-bc76-a043c94766a2 (28b63422-c1b8-47ac-bc76-a043c94766a2): created successfully Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf276f21-6a9f-4949-9e1a-d6a82f295392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (932508c1-3fa6-4a60-8d7f-4ef905405bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f5a4eed5-035f-47e0-af26-35a39de2207d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:49 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.345s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:49 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Deleted volume successfully. Sep 28 17:31:50 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:50 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-cb83553d-13b9-40d6-b98c-8470adc42139 tempest-CreateVolumesFromImageTest-110761290 None] Lock "cinder-194da242-c582-4d20-8b53-20516cb3cc26-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:50 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.339s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:50 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Deleted volume successfully. Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-36851135-4f82-4cb8-8261-175908edb77a tempest-CinderUnicodeTest-1848518517 None] Lock "cinder-0b3e0e6e-8e73-445f-b1c5-6e18aaeb573b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:50 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 1073741824" returned: 0 in 0.714s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:50 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 Sep 28 17:31:50 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:50 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" returned: 0 in 0.333s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491816867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c467e07c-0447-40d0-9950-83a55ab77041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:48Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume c467e07c-0447-40d0-9950-83a55ab77041 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:50 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcf7d0c-6b74-4527-b4b9-e7dd1a2fc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce12557f-00ba-4b35-b41d-a69b75e5a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:51 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 1073741824 Sep 28 17:31:51 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:51 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 (d97a0b0d-91a6-4d42-9d63-4e336f5c8272): created successfully Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce12557f-00ba-4b35-b41d-a69b75e5a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (80682638-58d7-41f0-a9b3-791dcce1638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a691aed2-1049-4c38-bdc1-5d2ecb16030d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:51 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 1073741824" returned: 0 in 0.654s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:51 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 Sep 28 17:31:51 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:51 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811362079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f751be5f-bd4f-45b7-9818-87ad72900f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd0de4950b648128fb6dd39a53fd391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:49Z,use_quota=True,user_id='2a3356cd21bd4533a7158ea5c65b3a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Creating volume f751be5f-bd4f-45b7-9818-87ad72900f81 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:51 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55b7572-df54-4150-8169-bfdf5f43780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c467e07c-0447-40d0-9950-83a55ab77041', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:52 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 1073741824 Sep 28 17:31:52 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a5f836-d0ea-485c-9488-2fc50013cfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:52 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-c467e07c-0447-40d0-9950-83a55ab77041 (c467e07c-0447-40d0-9950-83a55ab77041): created successfully Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a5f836-d0ea-485c-9488-2fc50013cfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (f47c473d-9011-41db-8dbf-4587a3bee9dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9fabdec4-e249-471a-b685-be4ab6325a14 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:52 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 1073741824" returned: 0 in 0.643s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:52 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 Sep 28 17:31:52 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:52 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81" returned: 0 in 0.310s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:52 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2259891-1fdd-42bc-b84a-51b131903a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f751be5f-bd4f-45b7-9818-87ad72900f81', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57784a04-2752-49b6-8895-4fe59c5baaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:53 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Volume volume-f751be5f-bd4f-45b7-9818-87ad72900f81 (f751be5f-bd4f-45b7-9818-87ad72900f81): created successfully Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57784a04-2752-49b6-8895-4fe59c5baaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Flow 'volume_create_manager' (82be741b-1d1d-47e9-9cd8-695ab69d15ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:53 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-7afdfe01-faa8-451e-b4d2-2d8ce0d70db9 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created volume successfully. Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-f751be5f-bd4f-45b7-9818-87ad72900f81-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-f751be5f-bd4f-45b7-9818-87ad72900f81-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-f751be5f-bd4f-45b7-9818-87ad72900f81" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-f751be5f-bd4f-45b7-9818-87ad72900f81" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cdfdb0-7dd1-4ec9-b659-857e7d8437c3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:54 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 Sep 28 17:31:54 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:54 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:54 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81 Sep 28 17:31:54 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:54 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-f751be5f-bd4f-45b7-9818-87ad72900f81" returned: 0 in 0.355s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-f751be5f-bd4f-45b7-9818-87ad72900f81" released by "delete_volume" :: held 1.023s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=185,cinder:UPDATE=207,cinder:INSERT=61,cinder:DELETE=22 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:UPDATE=253,cinder:SELECT=162,cinder:DELETE=21,cinder:INSERT=64 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['166e5e7d-bd50-46c4-9fca-015fefc31f85', 'a8fae832-f225-442a-9dd1-28b810277645', 'f7925c52-2542-4bb4-9c4a-40b93d87420f', '953b89a3-0977-4a6a-b840-30a8704f374e'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:55 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:55 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:55 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.361s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:55 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:31:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-9b0d710e-2441-4857-890b-4e7fd74c9c2c tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-f751be5f-bd4f-45b7-9818-87ad72900f81-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d7be4b12-8263-4ea4-93b7-3a71afa0db6c tempest-ProjectAdminTests-1735358152 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1181449890137, 'free_capacity_gb': 1775.1181449890137, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86929) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-c467e07c-0447-40d0-9950-83a55ab77041-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-c467e07c-0447-40d0-9950-83a55ab77041-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-c467e07c-0447-40d0-9950-83a55ab77041" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-c467e07c-0447-40d0-9950-83a55ab77041" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[af531250-ec6e-4ac8-9940-f08d3faafe45]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:56 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 Sep 28 17:31:56 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Flow 'volume_create_manager' (69173f92-7cc2-4846-a101-041c36594dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6032bf-fbf3-4dd4-8428-db7a83c0c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:57 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041" returned: 0 in 0.478s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6032bf-fbf3-4dd4-8428-db7a83c0c021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3bf2b7b5d84a51ad7627970d060698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:57Z,use_quota=True,user_id='230107a5274d49ddafb239e73f61f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43a6e10-434e-4463-8041-e868ce6733e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43a6e10-434e-4463-8041-e868ce6733e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:57 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041 Sep 28 17:31:57 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4945be8-51ea-4df9-a0ab-4d75e2220f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4945be8-51ea-4df9-a0ab-4d75e2220f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69', 'volume_name': 'volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a9f4f1-02d7-45c9-8ba0-bcc75bee290d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a9f4f1-02d7-45c9-8ba0-bcc75bee290d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d2f9ca-1118-43d6-a2bc-493afe7a64c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Volume 76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69', 'volume_size': 1} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3bf2b7b5d84a51ad7627970d060698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:31:57Z,use_quota=True,user_id='230107a5274d49ddafb239e73f61f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Creating volume 76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:31:57 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:57 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 1073741824 Sep 28 17:31:57 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:57 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c467e07c-0447-40d0-9950-83a55ab77041" returned: 0 in 0.400s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-c467e07c-0447-40d0-9950-83a55ab77041" released by "delete_volume" :: held 0.948s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['7d2df0f5-d760-4570-8c5e-72f749601492', '3c5f158e-9097-4e60-9171-a04e299fdfc5', '42738d17-9542-4e47-b004-8e67191ea105', '7a501b86-1c3a-44c0-a8c2-0b4a7e84883b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:57 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:31:57 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:57 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 1073741824" returned: 0 in 0.690s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:57 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 Sep 28 17:31:57 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:58 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.388s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:31:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-1255ff72-1022-424a-81b5-9c36483dbd59 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-c467e07c-0447-40d0-9950-83a55ab77041-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:58 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" returned: 0 in 0.322s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d2f9ca-1118-43d6-a2bc-493afe7a64c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da1d515-bf0b-4767-9859-6e8564b1d615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:31:58 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Volume volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 (76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69): created successfully Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da1d515-bf0b-4767-9859-6e8564b1d615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Flow 'volume_create_manager' (69173f92-7cc2-4846-a101-041c36594dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:31:58 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-d919f12f-9eaa-481f-9004-cb5fa38c0965 tempest-ProjectReaderTests-1082936448 None] Created volume successfully. Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-d97a0b0d-91a6-4d42-9d63-4e336f5c8272-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-d97a0b0d-91a6-4d42-9d63-4e336f5c8272-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d657c-8a28-41f9-a631-ac69145352cc]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:59 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 Sep 28 17:31:59 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:59 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" returned: 0 in 0.515s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:59 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272 Sep 28 17:31:59 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Acquiring lock "cinder-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "cinder-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Acquiring lock "cinder-quobyte-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "cinder-quobyte-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[12428004-dd64-4800-ab68-28ec8206bf35]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:31:59 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" returned: 0 in 0.419s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-d97a0b0d-91a6-4d42-9d63-4e336f5c8272" released by "delete_volume" :: held 1.013s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:31:59 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 Sep 28 17:31:59 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:31:59 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['e655cfc7-6af6-4903-b964-2acc76ec87c1', 'af85ff1d-c965-415c-b2a8-074e2d86afd7', 'eb066be3-1772-4cce-b989-83c3930c31ed', 'cd95142b-1e30-4b50-a78c-b3582bf6e00b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:00 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:00 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:00 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" returned: 0 in 0.535s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:00 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69 Sep 28 17:32:00 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:00 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.326s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3f8fb2dc-4d80-44f1-a5aa-a7b31e622695 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-d97a0b0d-91a6-4d42-9d63-4e336f5c8272-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:00 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" returned: 0 in 0.317s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "cinder-quobyte-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69" released by "delete_volume" :: held 0.926s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Created reservations ['044547b4-610c-4ab5-9b81-b21a9f5376b7', 'f183027a-66ab-44a8-a80f-8d77195d6ef0', 'ac46145c-405b-4e3f-933b-c88854c41085', '2bf83f5f-20fa-4f35-a044-a6e7cb26a303'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:00 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:00 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-28b63422-c1b8-47ac-bc76-a043c94766a2-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:01 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.448s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Deleted volume successfully. Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-28b63422-c1b8-47ac-bc76-a043c94766a2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c9d99a27-f66e-450c-bfcc-219978691fae tempest-ProjectReaderTests-1082936448 None] Lock "cinder-76a0b18e-e02d-40a6-ac4b-9d8a8d2c0d69-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-28b63422-c1b8-47ac-bc76-a043c94766a2" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-28b63422-c1b8-47ac-bc76-a043c94766a2" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a080cf-3559-4272-a6d3-627deb159915]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Flow 'volume_create_manager' (60b7adb0-e828-4191-9e52-161c72c1db72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce957bd-b355-4ec9-9bcf-aab5e0e8ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:01 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 Sep 28 17:32:01 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce957bd-b355-4ec9-9bcf-aab5e0e8ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453084287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663f55cd-5789-42e5-ba1b-c6e21001c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3bf2b7b5d84a51ad7627970d060698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:01Z,use_quota=True,user_id='230107a5274d49ddafb239e73f61f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca7d6c-a76e-427b-9713-1b9238b5972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faca7d6c-a76e-427b-9713-1b9238b5972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7395545a-d200-4a78-bfb5-492cf052f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7395545a-d200-4a78-bfb5-492cf052f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663f55cd-5789-42e5-ba1b-c6e21001c5d0', 'volume_name': 'volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d912cc-9c41-4821-a40a-2069dd91d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d912cc-9c41-4821-a40a-2069dd91d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48061fc9-00c4-437c-b2d8-9aaeca28adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:01 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Volume 663f55cd-5789-42e5-ba1b-c6e21001c5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0', 'volume_size': 1} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453084287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663f55cd-5789-42e5-ba1b-c6e21001c5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3bf2b7b5d84a51ad7627970d060698',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:01Z,use_quota=True,user_id='230107a5274d49ddafb239e73f61f75a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Creating volume 663f55cd-5789-42e5-ba1b-c6e21001c5d0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:01 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:01 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 1073741824 Sep 28 17:32:01 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:02 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2" returned: 0 in 0.745s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:02 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2 Sep 28 17:32:02 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:02 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 1073741824" returned: 0 in 0.652s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:02 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 Sep 28 17:32:02 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:02 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-28b63422-c1b8-47ac-bc76-a043c94766a2" returned: 0 in 0.582s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-28b63422-c1b8-47ac-bc76-a043c94766a2" released by "delete_volume" :: held 1.399s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['1804c1c3-f4a4-4feb-8705-cb4006b4bd9c', '20598277-aecb-4fba-940c-4cc1ff28b6a5', 'bf2b8567-424d-4492-b866-53c0ce5ac447', 'e7bc7ea8-732c-45b0-a443-be16160915ec'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:02 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0" returned: 0 in 0.464s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48061fc9-00c4-437c-b2d8-9aaeca28adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d168fe64-ebd3-488a-8d9f-505edd82a25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:02 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Volume volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 (663f55cd-5789-42e5-ba1b-c6e21001c5d0): created successfully Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d168fe64-ebd3-488a-8d9f-505edd82a25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Flow 'volume_create_manager' (60b7adb0-e828-4191-9e52-161c72c1db72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:02 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8705d24d-98ea-47ba-b2f3-4b2562aadbef tempest-ProjectReaderTests-1082936448 None] Created volume successfully. Sep 28 17:32:03 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:03 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:03 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.358s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-42912993-ddba-4361-bd15-1a5c4112de28 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-28b63422-c1b8-47ac-bc76-a043c94766a2-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-0c2a8390-8e8c-488d-9d91-a78859560cf0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-0c2a8390-8e8c-488d-9d91-a78859560cf0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Flow 'volume_create_manager' (da9db91b-8937-4385-a5dc-272ecbef3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb20c74-0d31-412a-9798-adbfe7e5809e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Acquiring lock "cinder-663f55cd-5789-42e5-ba1b-c6e21001c5d0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-0c2a8390-8e8c-488d-9d91-a78859560cf0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb20c74-0d31-412a-9798-adbfe7e5809e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1152246165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed319c7-cae6-40d5-9e4d-0b463af8c56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac74fd874ec469ea8f00b30cdce4492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:04Z,use_quota=True,user_id='19c922edc0684e1e8feefdcfba2ce5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d7e21a-9438-4d6e-8929-c53fb632b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d7e21a-9438-4d6e-8929-c53fb632b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8588ff2-3efb-4083-ab2d-7389fdbc72f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8588ff2-3efb-4083-ab2d-7389fdbc72f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed319c7-cae6-40d5-9e4d-0b463af8c56b', 'volume_name': 'volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6421c5-32d6-4d1b-9f12-4f19aa0f1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6421c5-32d6-4d1b-9f12-4f19aa0f1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99658a45-18a9-403f-8383-7e54da00b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:03 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Volume aed319c7-cae6-40d5-9e4d-0b463af8c56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b', 'volume_size': 1} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1152246165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed319c7-cae6-40d5-9e4d-0b463af8c56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac74fd874ec469ea8f00b30cdce4492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:04Z,use_quota=True,user_id='19c922edc0684e1e8feefdcfba2ce5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Creating volume aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:03 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "cinder-663f55cd-5789-42e5-ba1b-c6e21001c5d0-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:03 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b 1073741824 Sep 28 17:32:03 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-0c2a8390-8e8c-488d-9d91-a78859560cf0" acquired by "delete_volume" :: waited 0.104s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27a74ab-0c65-40f3-910a-f1eaf84f66a7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Acquiring lock "cinder-quobyte-663f55cd-5789-42e5-ba1b-c6e21001c5d0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "cinder-quobyte-663f55cd-5789-42e5-ba1b-c6e21001c5d0" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86ce5c-f6db-4d59-8187-9554bad207a3]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:03 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 Sep 28 17:32:03 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:04 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 Sep 28 17:32:04 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:04 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0" returned: 0 in 0.494s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b 1073741824" returned: 0 in 0.581s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0 Sep 28 17:32:04 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:04 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0" returned: 0 in 0.531s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:04 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:04 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0 Sep 28 17:32:04 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:04 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-0c2a8390-8e8c-488d-9d91-a78859560cf0" returned: 0 in 0.304s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-0c2a8390-8e8c-488d-9d91-a78859560cf0" released by "delete_volume" :: held 0.863s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:04 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.347s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99658a45-18a9-403f-8383-7e54da00b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5056f69f-5c4f-445c-abca-01b5119a3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['c81589b6-d58a-4b1b-956c-4695fc7eb029', '41571b32-d583-4160-8be9-3b19a251baa9', '2a1d9109-b567-43b0-b707-7e4c54af1e0e', 'c0f5cd6a-982d-49d5-a642-50ed5964749b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:04 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Volume volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b (aed319c7-cae6-40d5-9e4d-0b463af8c56b): created successfully Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5056f69f-5c4f-445c-abca-01b5119a3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:04 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Flow 'volume_create_manager' (da9db91b-8937-4385-a5dc-272ecbef3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-663f55cd-5789-42e5-ba1b-c6e21001c5d0" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "cinder-quobyte-663f55cd-5789-42e5-ba1b-c6e21001c5d0" released by "delete_volume" :: held 1.003s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-38506899-a498-4e89-83db-359d37e5799b tempest-SnapshotDependencyTests-1496730207 None] Created volume successfully. Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Created reservations ['f2a90eca-d1b5-4823-9601-08894fb3e300', '97f6a2f5-a767-471c-a100-2376b948b252', 'd7014061-6485-434a-b5c6-0b683c0aae92', '28cb8779-5561-4149-b752-1e43def8432b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:04 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:05 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:05 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:05 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:05 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.287s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a54ac55c-79b8-4c34-8ca1-c275702cf7e7 tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-0c2a8390-8e8c-488d-9d91-a78859560cf0-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:05 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:05 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Deleted volume successfully. Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-aa262d67-4fe5-4b1d-bdac-93f29c5429cf tempest-ProjectReaderTests-1082936448 None] Lock "cinder-663f55cd-5789-42e5-ba1b-c6e21001c5d0-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-d5eef721-3525-4925-bfa4-89e78a5425e2-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-d5eef721-3525-4925-bfa4-89e78a5425e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:05 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "cinder-quobyte-d5eef721-3525-4925-bfa4-89e78a5425e2" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-d5eef721-3525-4925-bfa4-89e78a5425e2" acquired by "delete_volume" :: waited 0.037s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Creating offline snapshot 9676af3b-239b-4f3f-91cf-388915860ab2 of volume aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dacf0b3-1858-4b1a-8872-9b6a1a78cb33]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c625bb-f24e-4527-9b5f-472fb5aeda7e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:06 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 Sep 28 17:32:06 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:06 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:06 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:06 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:06 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2" returned: 0 in 0.491s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:06 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2 Sep 28 17:32:06 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:06 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 1G Sep 28 17:32:06 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:06 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d5eef721-3525-4925-bfa4-89e78a5425e2" returned: 0 in 0.315s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-quobyte-d5eef721-3525-4925-bfa4-89e78a5425e2" released by "delete_volume" :: held 0.872s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:06 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Created reservations ['0ee53de5-fd31-4c6f-9f9f-92ff301cbbf2', '680faa70-a91c-42d4-a189-8dd5ac9a5e05', '6bd2dfaa-7aa8-4db4-b469-bc81d0811092', 'c61ca124-3ed8-4b44-a0b2-b7f2fe742f9c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:07 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:07 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:07 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 1G" returned: 0 in 0.623s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:07 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:07 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:07 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.316s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:07 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Deleted volume successfully. Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-174f7e3f-7410-4c42-8124-c5c274b1fa2d tempest-CreateVolumesFromSourceVolumeTest-238264149 None] Lock "cinder-d5eef721-3525-4925-bfa4-89e78a5425e2-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:07 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:07 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:07 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.528s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:07 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 is being set with open permissions: ugo+rw Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:07 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:07 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:07 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.352s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:32:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:32:08 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:08 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info Sep 28 17:32:08 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:08 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info" returned: 0 in 0.361s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:08 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info is being set with open permissions: ugo+rw Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:08 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info Sep 28 17:32:08 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (2c88286f-80f2-4799-94df-6f6825a7e7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:08 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f055443d-bc14-4ba6-8d92-f58f278e01f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f055443d-bc14-4ba6-8d92-f58f278e01f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867971672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bb07f6-7f27-4390-b4c4-8e25080af2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:09Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbc3c16-46f6-466f-83ab-98293f6795c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbc3c16-46f6-466f-83ab-98293f6795c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6767ca3-36c5-42b9-bda6-43291b5e8dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6767ca3-36c5-42b9-bda6-43291b5e8dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55bb07f6-7f27-4390-b4c4-8e25080af2ed', 'volume_name': 'volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1dd30-c2c9-47d8-aae7-b811a5ad6c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1dd30-c2c9-47d8-aae7-b811a5ad6c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fa7abc-023f-4920-8c93-4b365cad62d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Volume 55bb07f6-7f27-4390-b4c4-8e25080af2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed', 'volume_size': 1} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.info" returned: 0 in 0.439s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867971672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55bb07f6-7f27-4390-b4c4-8e25080af2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:09Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Creating volume 55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:09 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:09 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed 1073741824 Sep 28 17:32:09 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-411f413c-1d3d-4b07-baeb-b98550f7b550 tempest-SnapshotDependencyTests-1496730207 None] Create snapshot completed successfully Sep 28 17:32:09 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed 1073741824" returned: 0 in 0.479s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:09 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed Sep 28 17:32:09 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:09 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed" returned: 0 in 0.260s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92fa7abc-023f-4920-8c93-4b365cad62d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22302b9-fae0-4762-8386-2c4a130d8864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:09 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Volume volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed (55bb07f6-7f27-4390-b4c4-8e25080af2ed): created successfully Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22302b9-fae0-4762-8386-2c4a130d8864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:09 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (2c88286f-80f2-4799-94df-6f6825a7e7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:09 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-cb2ba93b-fd97-4a50-b1a5-8b3742bae5a6 tempest-ProjectReaderTests-744252029 None] Created volume successfully. Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Flow 'volume_create_manager' (67959dac-f3b1-45e0-9e14-1d3f55b397f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e8efe9-b00d-4520-9dee-f1c01af50b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e8efe9-b00d-4520-9dee-f1c01af50b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687f94da-0e5a-460e-abb5-7b7b46cacbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac74fd874ec469ea8f00b30cdce4492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9676af3b-239b-4f3f-91cf-388915860ab2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:11Z,use_quota=True,user_id='19c922edc0684e1e8feefdcfba2ce5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6d907c-652a-407d-a05b-453ed6d9bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6d907c-652a-407d-a05b-453ed6d9bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca523ba-c161-459e-90a3-be8ae8d3af34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca523ba-c161-459e-90a3-be8ae8d3af34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '687f94da-0e5a-460e-abb5-7b7b46cacbce', 'volume_name': 'volume-687f94da-0e5a-460e-abb5-7b7b46cacbce', 'volume_size': 1, 'snapshot_id': '9676af3b-239b-4f3f-91cf-388915860ab2'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d29de7-5b04-4265-859f-be9cf8bffec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d29de7-5b04-4265-859f-be9cf8bffec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cb27fd-69c4-4ec2-8610-6936151bf431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:10 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Volume 687f94da-0e5a-460e-abb5-7b7b46cacbce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-687f94da-0e5a-460e-abb5-7b7b46cacbce', 'volume_size': 1, 'snapshot_id': '9676af3b-239b-4f3f-91cf-388915860ab2'} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2-687f94da-0e5a-460e-abb5-7b7b46cacbce" by "_create_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2-687f94da-0e5a-460e-abb5-7b7b46cacbce" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Creating volume 687f94da-0e5a-460e-abb5-7b7b46cacbce from snapshot 9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" by "_copy_volume_from_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] snapshot: 9676af3b-239b-4f3f-91cf-388915860ab2, volume: 687f94da-0e5a-460e-abb5-7b7b46cacbce, {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747507e-5aa3-4d92-9dcb-2f451d17f4c7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:11 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:11 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:11 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.454s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad908f-b1ec-413b-aa57-57aa2111b366]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:11 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:11 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:11 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Creating direct copy from snapshot {{(pid=86929) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG cinder.utils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Path /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce not found in is_blk_device check {{(pid=86929) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:32:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:11 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce Sep 28 17:32:11 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:19 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce" returned: 0 in 7.149s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.image.image_utils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Image conversion details: src /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce {{(pid=86929) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:32:19 devstack cinder-volume[86929]: INFO cinder.image.image_utils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Converted 1024.00 MB image at 143.21 MB/s Sep 28 17:32:19 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce is being set with open permissions: ugo+rw Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:19 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce Sep 28 17:32:19 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (578dd745-7dac-4133-a63d-34625a2e07d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3dc9a-bea1-42a0-a8b2-94c38795fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3dc9a-bea1-42a0-a8b2-94c38795fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103612819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3301a042-d01a-4e0f-981e-3716c80676e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:19Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33741090-e051-46ea-8802-2cfa193b8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33741090-e051-46ea-8802-2cfa193b8189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573f662f-6a60-4b21-8e56-dde7337ee701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573f662f-6a60-4b21-8e56-dde7337ee701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3301a042-d01a-4e0f-981e-3716c80676e7', 'volume_name': 'volume-3301a042-d01a-4e0f-981e-3716c80676e7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de89dd40-901b-4dfa-8a33-e9527015bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de89dd40-901b-4dfa-8a33-e9527015bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724c641-4225-4746-a927-b0095a775c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Volume 3301a042-d01a-4e0f-981e-3716c80676e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3301a042-d01a-4e0f-981e-3716c80676e7', 'volume_size': 1} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:19 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce" returned: 0 in 0.286s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" released by "_copy_volume_from_snapshot" :: held 8.388s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2-687f94da-0e5a-460e-abb5-7b7b46cacbce" released by "_create_volume_from_snapshot" :: held 8.465s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.489s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.113s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Creating offline snapshot 53c94518-4458-4e0d-8eb7-68c6b998eba0 of volume 55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cb27fd-69c4-4ec2-8610-6936151bf431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687f94da-0e5a-460e-abb5-7b7b46cacbce', 'volume_size': 1, 'snapshot_id': '9676af3b-239b-4f3f-91cf-388915860ab2'}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296e619-c033-4cfc-a85c-faa473420f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d040cb-331b-4e36-9e67-6128e394f685]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:19 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Volume volume-687f94da-0e5a-460e-abb5-7b7b46cacbce (687f94da-0e5a-460e-abb5-7b7b46cacbce): created successfully Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4296e619-c033-4cfc-a85c-faa473420f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Flow 'volume_create_manager' (67959dac-f3b1-45e0-9e14-1d3f55b397f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2d05015f-cb92-4db8-b464-c7e636259a4e tempest-SnapshotDependencyTests-1496730207 None] Created volume successfully. Sep 28 17:32:19 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed Sep 28 17:32:19 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-9676af3b-239b-4f3f-91cf-388915860ab2-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-9676af3b-239b-4f3f-91cf-388915860ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Deleting offline snapshot 9676af3b-239b-4f3f-91cf-388915860ab2 of volume aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] snapshot_file for this snap is: volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[87488915-a299-4270-8300-c4677e888fd1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:19 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed" returned: 0 in 0.386s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:19 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 1G Sep 28 17:32:19 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:19 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:19 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:20 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4409e28b-d427-4aea-8efd-f44a902eef33]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:20 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 1G" returned: 0 in 0.422s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:20 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 Sep 28 17:32:20 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:20 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:20 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:20 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0" returned: 0 in 0.316s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:20 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 is being set with open permissions: ugo+rw Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:20 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 Sep 28 17:32:20 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:20 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.555s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:20 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:20 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:20 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0" returned: 0 in 0.280s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:20 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info Sep 28 17:32:20 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:21 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:21 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:21 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info is being set with open permissions: ugo+rw Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:21 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2 Sep 28 17:32:21 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:21 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info Sep 28 17:32:21 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:21 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b.9676af3b-239b-4f3f-91cf-388915860ab2" returned: 0 in 0.266s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:21 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.info" returned: 0 in 0.291s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-9676af3b-239b-4f3f-91cf-388915860ab2" released by "_delete_snapshot" :: held 1.734s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.205s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103612819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3301a042-d01a-4e0f-981e-3716c80676e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:19Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Creating volume 3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:21 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" released by "delete_snapshot" :: held 1.796s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:21 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 1073741824 Sep 28 17:32:21 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-9f744dbe-2cf3-4395-a45c-316f5b7ab46f tempest-ProjectReaderTests-744252029 None] Create snapshot completed successfully Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Created reservations ['8d51c06f-5580-416f-99a0-d398a06c27c1', 'ae58a9ed-92ce-4328-8778-8a8de24b2bdd', '29420273-a52d-478b-9e7b-e8126af9ebc7', '19e37fa3-714d-44c5-bd0b-4be2b1ccf35c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:21 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Delete snapshot completed successfully. Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-53a37b83-2be7-4547-ab28-cab7088dbf34 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-9676af3b-239b-4f3f-91cf-388915860ab2-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-aed319c7-cae6-40d5-9e4d-0b463af8c56b-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-aed319c7-cae6-40d5-9e4d-0b463af8c56b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:21 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ac4da8-ccbe-4705-b44f-fca48fbd4804]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 1073741824" returned: 0 in 0.562s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-53c94518-4458-4e0d-8eb7-68c6b998eba0-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:22 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:22 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-53c94518-4458-4e0d-8eb7-68c6b998eba0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:22 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-53c94518-4458-4e0d-8eb7-68c6b998eba0" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:22 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-53c94518-4458-4e0d-8eb7-68c6b998eba0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Deleting offline snapshot 53c94518-4458-4e0d-8eb7-68c6b998eba0 of volume 55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] snapshot_file for this snap is: volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a9d8fb-7a4d-4b2a-9912-9736491d227e]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 Sep 28 17:32:22 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:22 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7" returned: 0 in 0.365s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:22 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.480s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724c641-4225-4746-a927-b0095a775c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3301a042-d01a-4e0f-981e-3716c80676e7', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:22 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b Sep 28 17:32:22 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb9e415-8e94-4b83-baa2-0f51dbeea094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:22 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Volume volume-3301a042-d01a-4e0f-981e-3716c80676e7 (3301a042-d01a-4e0f-981e-3716c80676e7): created successfully Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb9e415-8e94-4b83-baa2-0f51dbeea094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (578dd745-7dac-4133-a63d-34625a2e07d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dd54ac34-7689-48f2-93b2-f1008dccc57b tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:32:22 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0" returned: 0 in 0.464s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:22 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aed319c7-cae6-40d5-9e4d-0b463af8c56b" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d4a43-2326-43bf-badc-27a95eb8afa1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-aed319c7-cae6-40d5-9e4d-0b463af8c56b" released by "delete_volume" :: held 0.838s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Created reservations ['d687dc04-c280-4a09-81a0-5b70483e11f6', 'a01101c8-5313-4d1e-a916-6062e39e5c18', '59d44ab9-6ecd-46e1-aba8-a8c4f1403722', '10b1071b-6eef-419d-a593-3c4473fcbe2f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:22 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed Sep 28 17:32:22 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:22 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:23 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-687f94da-0e5a-460e-abb5-7b7b46cacbce-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-687f94da-0e5a-460e-abb5-7b7b46cacbce-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc6e233-5e76-4f71-8ade-aa5c811ba5a5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:23 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed" returned: 0 in 0.423s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:23 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 Sep 28 17:32:23 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.350s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:23 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Deleted volume successfully. Sep 28 17:32:23 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce Sep 28 17:32:23 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4d43b05e-36d1-4e57-a7f9-a6b425ebfdc5 tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-aed319c7-cae6-40d5-9e4d-0b463af8c56b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:23 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0" returned: 0 in 0.418s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:23 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce" returned: 0 in 0.472s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:23 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0 Sep 28 17:32:23 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce Sep 28 17:32:23 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot c51da5fa-7e07-4fd8-856a-69f4ad1efcbd of volume 3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0bc187-95bd-4963-9ff4-4e744d26afab]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:23 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 Sep 28 17:32:23 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:23 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed.53c94518-4458-4e0d-8eb7-68c6b998eba0" returned: 0 in 0.299s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-687f94da-0e5a-460e-abb5-7b7b46cacbce" returned: 0 in 0.298s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-53c94518-4458-4e0d-8eb7-68c6b998eba0" released by "_delete_snapshot" :: held 1.745s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" released by "delete_snapshot" :: held 1.776s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-quobyte-687f94da-0e5a-460e-abb5-7b7b46cacbce" released by "delete_volume" :: held 0.838s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Created reservations ['e7cd6d29-fcac-48a2-8ccc-0e3d72d9e7bc', 'a63eaef5-9eb7-4d59-bf4a-9f7ad721a2af', '7b7f443e-9241-466f-a06c-77cea6b361fb', '5e485ed8-9f05-40cd-982f-194e4cf5bfa6'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Created reservations ['cc3b4645-6041-4f97-b41b-6dd4422b3bc9', '398bafc5-8bd1-4c55-a8c3-4140863d1b5b', 'c438c95b-2118-4d7c-a237-5e25f9d2ea26', '944bf6ed-6131-464b-8be0-96f79120b119'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:24 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:24 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:24 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:24 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd 1G Sep 28 17:32:24 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Delete snapshot completed successfully. Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e14155f7-f1ff-44f1-bf1c-04cf41d6a8db tempest-ProjectReaderTests-744252029 None] Lock "cinder-53c94518-4458-4e0d-8eb7-68c6b998eba0-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-55bb07f6-7f27-4390-b4c4-8e25080af2ed-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "cinder-55bb07f6-7f27-4390-b4c4-8e25080af2ed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:24 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.346s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" acquired by "delete_volume" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Deleted volume successfully. Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ab20f-9aff-4276-917c-2b557e4ca65d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-906805fa-076d-4232-878e-2517dd7134ee tempest-SnapshotDependencyTests-1496730207 None] Lock "cinder-687f94da-0e5a-460e-abb5-7b7b46cacbce-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:24 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed Sep 28 17:32:24 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:24 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd 1G" returned: 0 in 0.598s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3301a042-d01a-4e0f-981e-3716c80676e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:24 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3301a042-d01a-4e0f-981e-3716c80676e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd Sep 28 17:32:24 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:24 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed" returned: 0 in 0.410s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:25 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed Sep 28 17:32:25 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:25 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3301a042-d01a-4e0f-981e-3716c80676e7 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" returned: 0 in 0.352s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd is being set with open permissions: ugo+rw Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:25 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd Sep 28 17:32:25 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:25 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-55bb07f6-7f27-4390-b4c4-8e25080af2ed" returned: 0 in 0.324s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-55bb07f6-7f27-4390-b4c4-8e25080af2ed" released by "delete_volume" :: held 0.820s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Created reservations ['c334ad73-b6df-4198-889a-8fb8f44f0551', 'a73f44a1-c18a-41e4-abad-b076ed2dcbe7', '98b7725d-0267-4230-b7f0-7fe0b881a843', '4532c2e3-3fee-4628-b6f7-2dd87ae81199'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:25 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" returned: 0 in 0.319s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:25 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info Sep 28 17:32:25 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:25 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:25 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:25 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.284s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:25 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:25 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info is being set with open permissions: ugo+rw Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Deleted volume successfully. Sep 28 17:32:25 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info Sep 28 17:32:25 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:25 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-db9bcd68-00dc-459b-8efa-db428b644690 tempest-ProjectReaderTests-744252029 None] Lock "cinder-55bb07f6-7f27-4390-b4c4-8e25080af2ed-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:26 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.info" returned: 0 in 0.293s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (434f9242-0fe8-482f-b032-eb0c86721336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13d0190-d7d8-4c6a-a131-1e8f4ea846a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:26 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4d6740ff-8b3e-4a22-87ec-07090e38a423 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13d0190-d7d8-4c6a-a131-1e8f4ea846a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132164478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c28bb5f-a8a4-4e45-93c8-a883065364c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:26Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c89258-33c7-4fcc-b147-2d82871b5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c89258-33c7-4fcc-b147-2d82871b5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd385d4-39e5-4095-ba1b-953002326c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd385d4-39e5-4095-ba1b-953002326c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c28bb5f-a8a4-4e45-93c8-a883065364c8', 'volume_name': 'volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ac8e0f-c614-4aca-b323-6e900dab09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ac8e0f-c614-4aca-b323-6e900dab09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88239f76-d928-4dd8-964d-0ccb32a01534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:26 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Volume 5c28bb5f-a8a4-4e45-93c8-a883065364c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8', 'volume_size': 1} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132164478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c28bb5f-a8a4-4e45-93c8-a883065364c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:26Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Creating volume 5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:26 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:26 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 1073741824 Sep 28 17:32:26 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:26 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 1073741824" returned: 0 in 0.482s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:26 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 Sep 28 17:32:26 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot c51da5fa-7e07-4fd8-856a-69f4ad1efcbd of volume 3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b4319b-3a0a-4a7d-95d9-ab81c4989673]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:27 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:27 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8" returned: 0 in 0.290s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:27 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88239f76-d928-4dd8-964d-0ccb32a01534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a36445-e8b4-4c08-bf33-6b220ace814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:27 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Volume volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 (5c28bb5f-a8a4-4e45-93c8-a883065364c8): created successfully Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a36445-e8b4-4c08-bf33-6b220ace814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (434f9242-0fe8-482f-b032-eb0c86721336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:27 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f6f1208a-a802-4e89-b256-9ea479b66c2a tempest-ProjectReaderTests-744252029 None] Created volume successfully. Sep 28 17:32:27 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" returned: 0 in 0.474s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3301a042-d01a-4e0f-981e-3716c80676e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[44258f1d-6948-450c-9e28-6fafaeb33b44]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:27 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 Sep 28 17:32:27 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:27 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7" returned: 0 in 0.379s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:27 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd Sep 28 17:32:27 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:28 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" returned: 0 in 0.445s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:28 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd Sep 28 17:32:28 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Creating offline snapshot 412e71c9-bc95-47a6-9794-e2098d6fb84f of volume 5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08d7930-5950-47ed-8844-2e3f068444a8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:28 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7.c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" returned: 0 in 0.323s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd" released by "_delete_snapshot" :: held 1.743s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" released by "delete_snapshot" :: held 1.768s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:28 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 Sep 28 17:32:28 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Created reservations ['e5b1d4e6-5b67-4c71-acbe-09d76ad42aa4', '0332c467-20f6-4c39-83f8-1e478f664417', '03b8f648-cf64-4951-a837-e4f32116f56d', '3586da18-1162-46ad-8396-2e187f49ce12'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:32:28 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a3e251c1-7958-4c7e-beb3-1297e381cd67 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-c51da5fa-7e07-4fd8-856a-69f4ad1efcbd-delete_snapshot" released by "delete_snapshot" :: held 1.935s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:29 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:29 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f 1G Sep 28 17:32:29 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-3301a042-d01a-4e0f-981e-3716c80676e7-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "cinder-3301a042-d01a-4e0f-981e-3716c80676e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a75d795-f5d4-4106-9eb6-951587f363d8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:29 devstack sudo[109459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 Sep 28 17:32:29 devstack sudo[109459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:29 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f 1G" returned: 0 in 0.567s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:29 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f Sep 28 17:32:29 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:29 devstack sudo[109459]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7" returned: 0 in 0.447s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:29 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7 Sep 28 17:32:29 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:29 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f" returned: 0 in 0.359s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:29 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f is being set with open permissions: ugo+rw Sep 28 17:32:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:29 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f Sep 28 17:32:29 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:30 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-3301a042-d01a-4e0f-981e-3716c80676e7" returned: 0 in 0.270s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3301a042-d01a-4e0f-981e-3716c80676e7" released by "delete_volume" :: held 0.834s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Created reservations ['6e859dd6-0392-4c8c-b7cd-d12bd0cf9049', '7846140a-9155-4a0b-8e7b-df693e0af0dd', '67274108-3af6-4ab0-ae42-0f282ad57852', 'd5ca5e84-2ae0-4cff-ba32-b5c280fd0418'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:30 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:30 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:30 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f" returned: 0 in 0.325s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:30 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info Sep 28 17:32:30 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:30 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.370s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:30 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-2df30f49-d997-4d48-b781-8bc1dd9da8dc tempest-ProjectMemberTests-1556191539 None] Lock "cinder-3301a042-d01a-4e0f-981e-3716c80676e7-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:30 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info" returned: 0 in 0.371s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:30 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info is being set with open permissions: ugo+rw Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:30 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info Sep 28 17:32:30 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (0c6a053d-dbf3-46c1-8c31-47a0b50e37ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625c1d31-d1f9-464d-954e-a7c5890f726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:30 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.info" returned: 0 in 0.292s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625c1d31-d1f9-464d-954e-a7c5890f726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537045934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ec4970-d031-4895-8606-f09ad37d41ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:31Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2259957a-7e3f-4e0d-ab16-85056e032af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2259957a-7e3f-4e0d-ab16-85056e032af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc13f65d-f869-45df-a241-7445457388f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc13f65d-f869-45df-a241-7445457388f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ec4970-d031-4895-8606-f09ad37d41ae', 'volume_name': 'volume-b6ec4970-d031-4895-8606-f09ad37d41ae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca03fb4-aece-41ec-9458-3a4ece867f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca03fb4-aece-41ec-9458-3a4ece867f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92d86a9-0a9d-446b-b199-6fff3b3103ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Volume b6ec4970-d031-4895-8606-f09ad37d41ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ec4970-d031-4895-8606-f09ad37d41ae', 'volume_size': 1} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537045934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ec4970-d031-4895-8606-f09ad37d41ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:31Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Creating volume b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:31 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:31 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae 1073741824 Sep 28 17:32:31 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4bc3860c-fd9a-4ea5-a40a-b08c99c3591d tempest-ProjectReaderTests-744252029 None] Create snapshot completed successfully Sep 28 17:32:31 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae 1073741824" returned: 0 in 0.458s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:31 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae Sep 28 17:32:31 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-412e71c9-bc95-47a6-9794-e2098d6fb84f-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-412e71c9-bc95-47a6-9794-e2098d6fb84f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-412e71c9-bc95-47a6-9794-e2098d6fb84f" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-412e71c9-bc95-47a6-9794-e2098d6fb84f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Deleting offline snapshot 412e71c9-bc95-47a6-9794-e2098d6fb84f of volume 5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] snapshot_file for this snap is: volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:31 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92d86a9-0a9d-446b-b199-6fff3b3103ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ec4970-d031-4895-8606-f09ad37d41ae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d596ac1c-8662-4a19-a469-7adb9f60ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70179cd-f21c-45b4-aa64-d6e37ab0aeb6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:31 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Volume volume-b6ec4970-d031-4895-8606-f09ad37d41ae (b6ec4970-d031-4895-8606-f09ad37d41ae): created successfully Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d596ac1c-8662-4a19-a469-7adb9f60ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:31 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (0c6a053d-dbf3-46c1-8c31-47a0b50e37ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3643065f-58de-4a35-85f7-149535fcf966 tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:32:31 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f Sep 28 17:32:31 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:32 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ffca8-cc86-4c61-9f44-3c965975b2e6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:32 devstack sudo[109504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 Sep 28 17:32:32 devstack sudo[109504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:32 devstack sudo[109504]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8" returned: 0 in 0.384s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:32 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f Sep 28 17:32:32 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:33 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f Sep 28 17:32:33 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot fc75603b-ce51-4fa6-84ad-7f9f69d557a0 of volume b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[397bab17-3aea-403c-8324-39afebdb67e8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:33 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8.412e71c9-bc95-47a6-9794-e2098d6fb84f" returned: 0 in 0.368s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:33 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae Sep 28 17:32:33 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-412e71c9-bc95-47a6-9794-e2098d6fb84f" released by "_delete_snapshot" :: held 1.725s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" released by "delete_snapshot" :: held 1.757s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Created reservations ['14674631-ef0b-40d8-ae18-bcf6b78df3f1', '729dfc65-71fb-49df-a11d-0ceb8c404442', 'f57b64d6-6d23-43a4-b1cb-0e73e9735712', '757ce266-2f62-49e8-8025-468ec4428ba6'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Delete snapshot completed successfully. Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a38f52a6-ee4a-42f8-965c-ae95f472380f tempest-ProjectReaderTests-744252029 None] Lock "cinder-412e71c9-bc95-47a6-9794-e2098d6fb84f-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:33 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae" returned: 0 in 0.452s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:33 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 1G Sep 28 17:32:33 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-5c28bb5f-a8a4-4e45-93c8-a883065364c8-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "cinder-5c28bb5f-a8a4-4e45-93c8-a883065364c8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f943f6-2009-4a2c-aab5-53ba88bd59d4]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:34 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 Sep 28 17:32:34 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:34 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 1G" returned: 0 in 0.591s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec4970-d031-4895-8606-f09ad37d41ae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:34 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec4970-d031-4895-8606-f09ad37d41ae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 Sep 28 17:32:34 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:34 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8" returned: 0 in 0.526s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:34 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8 Sep 28 17:32:34 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:34 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ec4970-d031-4895-8606-f09ad37d41ae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0" returned: 0 in 0.393s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:34 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 is being set with open permissions: ugo+rw Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:34 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 Sep 28 17:32:34 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:34 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-5c28bb5f-a8a4-4e45-93c8-a883065364c8" returned: 0 in 0.299s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-5c28bb5f-a8a4-4e45-93c8-a883065364c8" released by "delete_volume" :: held 0.927s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:34 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Created reservations ['b5c57542-d38d-4b4a-8f85-164b15f676a0', '8885ac2d-1c7e-4b76-bd3a-cd32c2c4a979', '9da847b0-8a83-43fa-bb3e-1d5f2e0c69cf', '1c227b91-a36a-4d5c-a095-154e80fb02b7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:35 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0" returned: 0 in 0.343s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:35 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:35 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info Sep 28 17:32:35 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:35 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.307s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Deleted volume successfully. Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-a8938c82-de54-49bd-a014-0084014a4b40 tempest-ProjectReaderTests-744252029 None] Lock "cinder-5c28bb5f-a8a4-4e45-93c8-a883065364c8-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:35 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info" returned: 0 in 0.342s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info is being set with open permissions: ugo+rw Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:35 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info Sep 28 17:32:35 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:35 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.info" returned: 0 in 0.301s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (54648bec-0e81-4919-803f-37dbe018ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913f708a-6d6a-46ad-b01d-55361d6f5721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913f708a-6d6a-46ad-b01d-55361d6f5721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859518923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dab7b53-3715-4a3b-9e68-4118a4e8efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:36Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a01739-021f-471d-860b-34176eb32cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a01739-021f-471d-860b-34176eb32cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46526aa-4b11-4cbb-80c3-1b2e4ca9f898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46526aa-4b11-4cbb-80c3-1b2e4ca9f898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dab7b53-3715-4a3b-9e68-4118a4e8efae', 'volume_name': 'volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce52fcb-373f-4160-8ca3-f2ab0d50f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce52fcb-373f-4160-8ca3-f2ab0d50f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bf5866-3d14-4085-a716-6ce3a4fe5c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:35 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Volume 4dab7b53-3715-4a3b-9e68-4118a4e8efae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae', 'volume_size': 1} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1859518923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dab7b53-3715-4a3b-9e68-4118a4e8efae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:36Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Creating volume 4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:35 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f7e38e78-10a4-469e-a6f1-cec36c484ef1 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:32:35 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae 1073741824 Sep 28 17:32:35 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-fc75603b-ce51-4fa6-84ad-7f9f69d557a0-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-fc75603b-ce51-4fa6-84ad-7f9f69d557a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:36 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae 1073741824" returned: 0 in 0.541s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-fc75603b-ce51-4fa6-84ad-7f9f69d557a0" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-fc75603b-ce51-4fa6-84ad-7f9f69d557a0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot fc75603b-ce51-4fa6-84ad-7f9f69d557a0 of volume b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[516dcd95-3c57-4c45-9031-b8c70802c0e7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:36 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae Sep 28 17:32:36 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:36 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 Sep 28 17:32:36 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:36 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae" returned: 0 in 0.287s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bf5866-3d14-4085-a716-6ce3a4fe5c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834ae27-8a3d-4d93-80ab-7baa2f09a36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Volume volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae (4dab7b53-3715-4a3b-9e68-4118a4e8efae): created successfully Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834ae27-8a3d-4d93-80ab-7baa2f09a36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (54648bec-0e81-4919-803f-37dbe018ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:36 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-aa1aa72b-390b-4842-aaac-c21c1b669a2a tempest-ProjectReaderTests-744252029 None] Created volume successfully. Sep 28 17:32:37 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0" returned: 0 in 0.427s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ec4970-d031-4895-8606-f09ad37d41ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233fc72-98f9-48eb-95f3-35139264fdad]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:37 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae Sep 28 17:32:37 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:37 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:37 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 Sep 28 17:32:37 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:37 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0" returned: 0 in 0.341s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:37 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0 Sep 28 17:32:37 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Creating offline snapshot 323f060b-5962-44a6-8744-80b2ee87b960 of volume 4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:38 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae.fc75603b-ce51-4fa6-84ad-7f9f69d557a0" returned: 0 in 0.274s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f853ac26-195f-4dbc-b0e4-90da79d052c8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-fc75603b-ce51-4fa6-84ad-7f9f69d557a0" released by "_delete_snapshot" :: held 1.601s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" released by "delete_snapshot" :: held 1.634s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:38 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae Sep 28 17:32:38 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Created reservations ['b819891d-3c03-447e-8718-4b6d776b554f', '9bb60d97-f1be-4e60-ac16-e609cc90d2aa', '7cc69368-54fc-4a51-a78c-f89ad52849ce', '23ffe76d-cb53-4550-b4ce-311e0c5a313f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-616355e7-cf39-491e-8748-3ba07ab6261c tempest-ProjectMemberTests-1556191539 None] Lock "cinder-fc75603b-ce51-4fa6-84ad-7f9f69d557a0-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:38 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae" returned: 0 in 0.373s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:38 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 1G Sep 28 17:32:38 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-b6ec4970-d031-4895-8606-f09ad37d41ae-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-b6ec4970-d031-4895-8606-f09ad37d41ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f186a2c-d4d7-4955-8d80-fc8cfa32fb16]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:38 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:38 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae Sep 28 17:32:38 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 1G" returned: 0 in 0.486s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:38 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 Sep 28 17:32:38 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae" returned: 0 in 0.398s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:39 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae Sep 28 17:32:39 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960" returned: 0 in 0.320s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 is being set with open permissions: ugo+rw Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:39 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 Sep 28 17:32:39 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b6ec4970-d031-4895-8606-f09ad37d41ae" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-b6ec4970-d031-4895-8606-f09ad37d41ae" released by "delete_volume" :: held 0.734s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:39 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960" returned: 0 in 0.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Created reservations ['0fd0c4ae-7e84-4627-941a-783f5c662645', '17fdedd8-27ce-4bec-9ba4-2b2e4868a91e', 'f99c02c8-28e3-4089-92da-bc7ffc7df282', '380ecf5b-5c71-4842-aa48-eb70c289c306'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:39 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info Sep 28 17:32:39 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:39 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:39 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info" returned: 0 in 0.265s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info is being set with open permissions: ugo+rw Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:39 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info Sep 28 17:32:39 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:39 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:39 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:32:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-34876657-b889-4a5b-bc66-c2383dd35433 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-b6ec4970-d031-4895-8606-f09ad37d41ae-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:40 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.info" returned: 0 in 0.303s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6e7d61f4-b2ff-42e7-8011-fa82cc015332 tempest-ProjectReaderTests-744252029 None] Create snapshot completed successfully Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (edafa213-8eab-4810-89e5-c481c811e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad38df6-4dee-4a98-a8d7-e315586b25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad38df6-4dee-4a98-a8d7-e315586b25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283282914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ec347b-ea2e-4d02-80d3-0b153197ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:40Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a1b62a-5b23-431a-91ba-c046d61953d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a1b62a-5b23-431a-91ba-c046d61953d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a992eb0-2c35-44cc-a0d8-9f808662fc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a992eb0-2c35-44cc-a0d8-9f808662fc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ec347b-ea2e-4d02-80d3-0b153197ec7e', 'volume_name': 'volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a47a9-8b4c-42fc-a714-e4ab893b7922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8a47a9-8b4c-42fc-a714-e4ab893b7922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b2f9c9-e376-45f9-b318-a1493070e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:40 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Volume 08ec347b-ea2e-4d02-80d3-0b153197ec7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e', 'volume_size': 1} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283282914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ec347b-ea2e-4d02-80d3-0b153197ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:40Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Creating volume 08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:40 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:40 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e 1073741824 Sep 28 17:32:40 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:40 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e 1073741824" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:40 devstack sudo[109626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e Sep 28 17:32:40 devstack sudo[109626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:41 devstack sudo[109626]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e" returned: 0 in 0.256s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b2f9c9-e376-45f9-b318-a1493070e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bf6c32-f74c-4642-b22f-4c886b094da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Volume volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e (08ec347b-ea2e-4d02-80d3-0b153197ec7e): created successfully Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bf6c32-f74c-4642-b22f-4c886b094da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (edafa213-8eab-4810-89e5-c481c811e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-323f060b-5962-44a6-8744-80b2ee87b960-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-890f0825-b183-40dc-9438-50a4f88f6d0a tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-323f060b-5962-44a6-8744-80b2ee87b960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-323f060b-5962-44a6-8744-80b2ee87b960" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-323f060b-5962-44a6-8744-80b2ee87b960" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Deleting offline snapshot 323f060b-5962-44a6-8744-80b2ee87b960 of volume 4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] snapshot_file for this snap is: volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[82048e16-36fb-4d6d-ac32-7999fb3534c2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:41 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 Sep 28 17:32:41 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot 4f5bba81-5015-47ac-84a6-8590263ff056 of volume 08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bec8d2-5f70-4e2e-80ea-3afa890b5a58]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:41 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960" returned: 0 in 0.411s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:41 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e Sep 28 17:32:41 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f3901-b312-4277-8d63-32529b28b788]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:41 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae Sep 28 17:32:41 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:42 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 1G Sep 28 17:32:42 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae" returned: 0 in 0.388s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:42 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 Sep 28 17:32:42 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 1G" returned: 0 in 0.440s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:42 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 Sep 28 17:32:42 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960" returned: 0 in 0.374s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:42 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960 Sep 28 17:32:42 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056" returned: 0 in 0.312s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 is being set with open permissions: ugo+rw Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:42 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 Sep 28 17:32:42 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:42 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae.323f060b-5962-44a6-8744-80b2ee87b960" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-323f060b-5962-44a6-8744-80b2ee87b960" released by "_delete_snapshot" :: held 1.565s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" released by "delete_snapshot" :: held 1.599s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:42 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Created reservations ['bb390695-2ba2-4f0a-8afe-ad64e1e73f14', '1d9993bd-2de1-4446-951a-21c014b3b4b8', 'd5847c39-30b9-4ef0-94ed-d24939f8d6d2', '94ce284c-5195-4c28-a774-9f7e194f7269'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Delete snapshot completed successfully. Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e91c744e-22d4-48a4-8741-7109a46bb7d7 tempest-ProjectReaderTests-744252029 None] Lock "cinder-323f060b-5962-44a6-8744-80b2ee87b960-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:43 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056" returned: 0 in 0.273s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:43 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info Sep 28 17:32:43 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:43 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info" returned: 0 in 0.277s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:43 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info is being set with open permissions: ugo+rw Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:43 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info Sep 28 17:32:43 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-4dab7b53-3715-4a3b-9e68-4118a4e8efae-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "cinder-4dab7b53-3715-4a3b-9e68-4118a4e8efae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8838236-9fdb-40df-8650-c591263b76e1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:43 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.info" returned: 0 in 0.295s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:43 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae Sep 28 17:32:43 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:43 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3a6d8e2f-11a5-471c-ab5d-e48af8be3761 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:32:43 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae" returned: 0 in 0.386s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:43 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae Sep 28 17:32:43 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:44 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-4dab7b53-3715-4a3b-9e68-4118a4e8efae" returned: 0 in 0.252s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-4dab7b53-3715-4a3b-9e68-4118a4e8efae" released by "delete_volume" :: held 0.711s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Created reservations ['1d2ca167-43e4-4a49-b1ed-8c33162402d8', '52bbfffe-6a59-40eb-a8d0-bb6c2968e8dd', '85d69a38-4dd6-4966-96ba-568bd2c815fc', 'b1dbbd99-e030-4780-a545-6ad09458dd2c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:44 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:44 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:44 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.270s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Deleted volume successfully. Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6b397957-2431-420a-bfeb-f37fb7b198c9 tempest-ProjectReaderTests-744252029 None] Lock "cinder-4dab7b53-3715-4a3b-9e68-4118a4e8efae-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-4f5bba81-5015-47ac-84a6-8590263ff056-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-4f5bba81-5015-47ac-84a6-8590263ff056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-4f5bba81-5015-47ac-84a6-8590263ff056" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-4f5bba81-5015-47ac-84a6-8590263ff056" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot 4f5bba81-5015-47ac-84a6-8590263ff056 of volume 08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429ab4b-a4bd-4aca-b1e0-ec104dc09ba0]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:44 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 Sep 28 17:32:44 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (2bcb7cec-be5e-40d5-9c98-72470b83994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5aaacf-3add-4dd7-ba96-f1ba38ff63f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5aaacf-3add-4dd7-ba96-f1ba38ff63f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117763977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d989c9c0-1803-4fbc-826f-191acc44ee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:45Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbd24b3-19fb-4f54-a04d-340dbef7ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbd24b3-19fb-4f54-a04d-340dbef7ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25cc0c5-0c7a-45e6-b74a-abce0e1e1f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25cc0c5-0c7a-45e6-b74a-abce0e1e1f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd989c9c0-1803-4fbc-826f-191acc44ee93', 'volume_name': 'volume-d989c9c0-1803-4fbc-826f-191acc44ee93', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb15024-8fa3-4df5-81de-6ddcce868468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb15024-8fa3-4df5-81de-6ddcce868468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08743aae-7525-4e71-a232-2bc41becbc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Volume d989c9c0-1803-4fbc-826f-191acc44ee93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d989c9c0-1803-4fbc-826f-191acc44ee93', 'volume_size': 1} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1117763977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d989c9c0-1803-4fbc-826f-191acc44ee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:45Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Creating volume d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:45 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:45 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 1073741824 Sep 28 17:32:45 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:45 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056" returned: 0 in 0.403s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b232e92-aa83-4c1e-939b-80adfc327472]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:45 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e Sep 28 17:32:45 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:45 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 1073741824" returned: 0 in 0.468s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:45 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e" returned: 0 in 0.388s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:45 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 Sep 28 17:32:45 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:45 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 Sep 28 17:32:45 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:45 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93" returned: 0 in 0.261s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08743aae-7525-4e71-a232-2bc41becbc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d989c9c0-1803-4fbc-826f-191acc44ee93', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec2d7bf-5fe7-40ea-b809-7fd1f581c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Volume volume-d989c9c0-1803-4fbc-826f-191acc44ee93 (d989c9c0-1803-4fbc-826f-191acc44ee93): created successfully Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec2d7bf-5fe7-40ea-b809-7fd1f581c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (2bcb7cec-be5e-40d5-9c98-72470b83994b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3a78e1f2-3c96-4180-90a7-6096e9b8b3b1 tempest-ProjectReaderTests-744252029 None] Created volume successfully. Sep 28 17:32:46 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056" returned: 0 in 0.363s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:46 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056 Sep 28 17:32:46 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Creating offline snapshot a45db677-f497-4cc0-8c51-d3018afeb60c of volume d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c3d4d-1654-4914-8293-4d7d65be022d]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:46 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e.4f5bba81-5015-47ac-84a6-8590263ff056" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-4f5bba81-5015-47ac-84a6-8590263ff056" released by "_delete_snapshot" :: held 1.540s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" released by "delete_snapshot" :: held 1.564s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Created reservations ['df18fe0c-12a4-4d12-9d1e-af40179e3750', '1637cf17-ea64-4cf3-a44e-135a851a0825', '8bb911ef-847e-4652-9bc0-195de524af3a', '7ff53b6e-5471-4220-8f5e-83fd4a410bbc'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:46 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 Sep 28 17:32:46 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:46 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-fa9c59b0-8626-4c98-8539-a4ec24f402b7 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-4f5bba81-5015-47ac-84a6-8590263ff056-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:46 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93" returned: 0 in 0.417s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:46 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c 1G Sep 28 17:32:46 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-08ec347b-ea2e-4d02-80d3-0b153197ec7e-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:46 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-08ec347b-ea2e-4d02-80d3-0b153197ec7e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e408e25b-b9e3-4387-864b-b0ef2d76b9f8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e Sep 28 17:32:47 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:47 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c 1G" returned: 0 in 0.460s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d989c9c0-1803-4fbc-826f-191acc44ee93 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d989c9c0-1803-4fbc-826f-191acc44ee93 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c Sep 28 17:32:47 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:47 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e" returned: 0 in 0.379s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:47 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e Sep 28 17:32:47 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d989c9c0-1803-4fbc-826f-191acc44ee93 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c" returned: 0 in 0.287s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:47 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c is being set with open permissions: ugo+rw Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c Sep 28 17:32:47 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:47 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-08ec347b-ea2e-4d02-80d3-0b153197ec7e" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-08ec347b-ea2e-4d02-80d3-0b153197ec7e" released by "delete_volume" :: held 0.700s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:47 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c" returned: 0 in 0.287s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Created reservations ['ea72ea4b-84f3-475e-bcea-59633935a8f4', '3ba5c7be-51ff-48ab-ac3d-1ea37f090824', '1fcce793-91de-4275-8089-8efcaf1b864c', '78e87161-5a25-4080-993f-c11344ec8b3b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info Sep 28 17:32:47 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:47 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:47 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:48 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:48 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info is being set with open permissions: ugo+rw Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:48 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info Sep 28 17:32:48 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:48 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.275s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c57b24ed-e94d-4d8e-88ec-f4a518e85c80 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-08ec347b-ea2e-4d02-80d3-0b153197ec7e-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:48 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.info" returned: 0 in 0.297s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e808eb22-6aaa-41a8-a589-61b9a0aa152b tempest-ProjectReaderTests-744252029 None] Create snapshot completed successfully Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (fa25d00e-4cc0-4ea2-8a08-cc65b578b10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc85bc16-ddf5-40cb-ad46-d59144296112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc85bc16-ddf5-40cb-ad46-d59144296112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516979280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579081db-4aae-47e7-9c8e-75728f12c8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:49Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec1f7a9-6612-43f2-b689-8d39a205089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec1f7a9-6612-43f2-b689-8d39a205089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef2715c-86e3-4c56-b8d5-aae2f188b9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef2715c-86e3-4c56-b8d5-aae2f188b9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579081db-4aae-47e7-9c8e-75728f12c8b3', 'volume_name': 'volume-579081db-4aae-47e7-9c8e-75728f12c8b3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac54fd-936c-4ac0-904c-ca8396793312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac54fd-936c-4ac0-904c-ca8396793312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe3d392-25fd-44be-be59-ef614def3ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:48 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Volume 579081db-4aae-47e7-9c8e-75728f12c8b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579081db-4aae-47e7-9c8e-75728f12c8b3', 'volume_size': 1} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516979280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579081db-4aae-47e7-9c8e-75728f12c8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:49Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Creating volume 579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:48 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:48 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 1073741824 Sep 28 17:32:48 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:49 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 1073741824" returned: 0 in 0.407s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:49 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 Sep 28 17:32:49 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:49 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3" returned: 0 in 0.237s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe3d392-25fd-44be-be59-ef614def3ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579081db-4aae-47e7-9c8e-75728f12c8b3', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2cea2b-b32b-4ace-a296-da6f5b3a9bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:49 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Volume volume-579081db-4aae-47e7-9c8e-75728f12c8b3 (579081db-4aae-47e7-9c8e-75728f12c8b3): created successfully Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed2cea2b-b32b-4ace-a296-da6f5b3a9bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (fa25d00e-4cc0-4ea2-8a08-cc65b578b10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:49 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e568a953-8b02-4479-a92f-1928d7180588 tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-a45db677-f497-4cc0-8c51-d3018afeb60c-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-a45db677-f497-4cc0-8c51-d3018afeb60c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-a45db677-f497-4cc0-8c51-d3018afeb60c" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-a45db677-f497-4cc0-8c51-d3018afeb60c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Deleting offline snapshot a45db677-f497-4cc0-8c51-d3018afeb60c of volume d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] snapshot_file for this snap is: volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb680beb-d176-4500-9a3e-5d9837dc5c81]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:49 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c Sep 28 17:32:49 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot e10540a3-e3e3-472b-9d86-a0e5cc0373a1 of volume 579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[844c0578-bcb2-4191-8293-b249de1369a1]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:49 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d989c9c0-1803-4fbc-826f-191acc44ee93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:49 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 Sep 28 17:32:49 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[094883af-ddf8-4bdc-b76b-e53b5c4bd2f2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:49 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 Sep 28 17:32:50 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3" returned: 0 in 0.362s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 1G Sep 28 17:32:50 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c Sep 28 17:32:50 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 1G" returned: 0 in 0.436s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579081db-4aae-47e7-9c8e-75728f12c8b3 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579081db-4aae-47e7-9c8e-75728f12c8b3 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 Sep 28 17:32:50 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c Sep 28 17:32:50 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579081db-4aae-47e7-9c8e-75728f12c8b3 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1" returned: 0 in 0.307s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:50 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 is being set with open permissions: ugo+rw Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:50 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 Sep 28 17:32:50 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:50 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:50 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93.a45db677-f497-4cc0-8c51-d3018afeb60c" returned: 0 in 0.264s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-a45db677-f497-4cc0-8c51-d3018afeb60c" released by "_delete_snapshot" :: held 1.530s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" released by "delete_snapshot" :: held 1.553s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Created reservations ['41ff9afb-f268-4613-9829-a64b76c82d22', 'f8b029ea-6103-4128-afd3-2ede22b057b1', '0c27d1da-fbbb-4102-80a9-56579320dc1c', '48a8d2e0-2c6d-4ede-b023-424959fbdbc2'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Delete snapshot completed successfully. Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-94fcaad1-8339-41a5-9eac-2be48688ed6e tempest-ProjectReaderTests-744252029 None] Lock "cinder-a45db677-f497-4cc0-8c51-d3018afeb60c-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:51 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1" returned: 0 in 0.268s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:51 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info Sep 28 17:32:51 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:51 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info" returned: 0 in 0.259s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:51 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info is being set with open permissions: ugo+rw Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:51 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info Sep 28 17:32:51 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-d989c9c0-1803-4fbc-826f-191acc44ee93-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "cinder-d989c9c0-1803-4fbc-826f-191acc44ee93-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e64deb-1542-4d43-8f8c-002ccfa4c36f]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:51 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.info" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:51 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:51 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-dee1382a-565c-4fdd-9a42-11384e58722e tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:32:51 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 Sep 28 17:32:51 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:52 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93" returned: 0 in 0.407s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:52 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93 Sep 28 17:32:52 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:52 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-d989c9c0-1803-4fbc-826f-191acc44ee93" returned: 0 in 0.260s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-d989c9c0-1803-4fbc-826f-191acc44ee93" released by "delete_volume" :: held 0.743s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Created reservations ['0628847e-0b6c-4bbc-a0cc-3fbc32fc3641', '523a14ca-4cb7-4de6-919a-46601dc60f22', '09175a6d-6427-44b8-a0a0-9fdd9a22262a', 'ab6d52da-f29d-42d5-bc4d-84fc7f605d31'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:52 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:52 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:52 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.264s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:52 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Deleted volume successfully. Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-82a5651b-fc7b-40c0-a5df-e941e684200c tempest-ProjectReaderTests-744252029 None] Lock "cinder-d989c9c0-1803-4fbc-826f-191acc44ee93-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:52 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-e10540a3-e3e3-472b-9d86-a0e5cc0373a1-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e10540a3-e3e3-472b-9d86-a0e5cc0373a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-e10540a3-e3e3-472b-9d86-a0e5cc0373a1" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e10540a3-e3e3-472b-9d86-a0e5cc0373a1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot e10540a3-e3e3-472b-9d86-a0e5cc0373a1 of volume 579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f109fad4-b92f-4a35-be75-bc2220b95e70]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:53 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 Sep 28 17:32:53 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (0624aa0c-de97-4650-9d1f-871528b88e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea9bf9-6f18-4678-ab13-2136a93abbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fea9bf9-6f18-4678-ab13-2136a93abbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639072489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2c5d79-3def-46e3-8339-e4721e64a57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:53Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2ae42e-20bb-418f-828d-b31883ff4f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2ae42e-20bb-418f-828d-b31883ff4f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77bd371-72b0-4903-afed-cf81b0db32b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77bd371-72b0-4903-afed-cf81b0db32b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2c5d79-3def-46e3-8339-e4721e64a57e', 'volume_name': 'volume-ab2c5d79-3def-46e3-8339-e4721e64a57e', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17fb60-3f54-4240-a6cf-f8f8568e7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17fb60-3f54-4240-a6cf-f8f8568e7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07b4400-5aa8-4632-867d-caaaa6a1f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:53 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Volume ab2c5d79-3def-46e3-8339-e4721e64a57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2c5d79-3def-46e3-8339-e4721e64a57e', 'volume_size': 1} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639072489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2c5d79-3def-46e3-8339-e4721e64a57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f4136c5f25b4a56940657a1074f4431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:53Z,use_quota=True,user_id='11b329343f964cc6ac6f6c4e25af75fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Creating volume ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:53 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:53 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e 1073741824 Sep 28 17:32:53 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:53 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-579081db-4aae-47e7-9c8e-75728f12c8b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a99fce-0250-4979-9b34-9c004a864979]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:53 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 Sep 28 17:32:53 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:53 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e 1073741824" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:53 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e Sep 28 17:32:53 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:53 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3" returned: 0 in 0.391s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:53 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:53 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 Sep 28 17:32:53 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:54 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e" returned: 0 in 0.260s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07b4400-5aa8-4632-867d-caaaa6a1f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2c5d79-3def-46e3-8339-e4721e64a57e', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f36f93-46f4-49c3-8b75-a93f89ae0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:54 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Volume volume-ab2c5d79-3def-46e3-8339-e4721e64a57e (ab2c5d79-3def-46e3-8339-e4721e64a57e): created successfully Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f36f93-46f4-49c3-8b75-a93f89ae0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Flow 'volume_create_manager' (0624aa0c-de97-4650-9d1f-871528b88e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-db8509f8-8409-4b65-bebc-f22738744537 tempest-ProjectReaderTests-744252029 None] Created volume successfully. Sep 28 17:32:54 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1" returned: 0 in 0.375s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:54 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1 Sep 28 17:32:54 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Creating offline snapshot e4abd127-1409-401b-8e03-e8582d1fd55e of volume ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[782f6eaf-cb62-4af5-b824-8abde4fd1138]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:54 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3.e10540a3-e3e3-472b-9d86-a0e5cc0373a1" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e10540a3-e3e3-472b-9d86-a0e5cc0373a1" released by "_delete_snapshot" :: held 1.580s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" released by "delete_snapshot" :: held 1.603s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:54 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e Sep 28 17:32:54 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Created reservations ['e2c56897-3e1e-44e1-be5b-1e1d47cecd2c', 'a29b24c3-f16f-4b3d-bc4c-0054c7ffe3a2', '374deedf-2b45-498a-9947-be0909f309ce', '7d04c7e4-a3fb-48b0-acf0-83efa35700c3'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:54 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-6ea0aa14-8dc6-499f-a983-3b882913e208 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e10540a3-e3e3-472b-9d86-a0e5cc0373a1-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:54 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e" returned: 0 in 0.412s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:54 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:54 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e 1G Sep 28 17:32:54 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-579081db-4aae-47e7-9c8e-75728f12c8b3-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-579081db-4aae-47e7-9c8e-75728f12c8b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:INSERT=62,cinder:UPDATE=239,cinder:SELECT=181,cinder:DELETE=19 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=179,cinder:INSERT=64,cinder:UPDATE=238,cinder:DELETE=20 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f816d-fbe8-4b75-bd44-6ffff8e437b6]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:55 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:55 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 Sep 28 17:32:55 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e 1G" returned: 0 in 0.472s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2c5d79-3def-46e3-8339-e4721e64a57e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:55 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2c5d79-3def-46e3-8339-e4721e64a57e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e Sep 28 17:32:55 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:55 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:55 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2c5d79-3def-46e3-8339-e4721e64a57e -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e" returned: 0 in 0.298s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:55 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e is being set with open permissions: ugo+rw Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:55 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3 Sep 28 17:32:55 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:55 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e Sep 28 17:32:55 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:55 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-579081db-4aae-47e7-9c8e-75728f12c8b3" returned: 0 in 0.248s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-579081db-4aae-47e7-9c8e-75728f12c8b3" released by "delete_volume" :: held 0.740s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:55 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:55 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e" returned: 0 in 0.268s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:56 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info Sep 28 17:32:56 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Created reservations ['7ed9b75a-3ffa-44be-9df0-7a9d91bfe1c7', 'c26f7cc1-ae12-4f00-a8e1-bf5685bc8d5f', '9e8ad273-2897-411b-ac8e-f4f4def6dcd3', 'bbd83a5e-5f7c-4c5e-a8a8-42f7c6dca04c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:56 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:32:56 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:56 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:56 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info is being set with open permissions: ugo+rw Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:56 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info Sep 28 17:32:56 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:56 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.240s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:32:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-3169d2e5-b03f-493d-a1e4-007b46677a26 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-579081db-4aae-47e7-9c8e-75728f12c8b3-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:56 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.info" returned: 0 in 0.279s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:56 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-59eaf5a7-d2b4-4007-a295-db6050719c87 tempest-ProjectReaderTests-744252029 None] Create snapshot completed successfully Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (fc3ad22a-611d-4653-90bb-16836d1a426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0732f78-cae9-4ee0-b5d4-137b126159ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0732f78-cae9-4ee0-b5d4-137b126159ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643157789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb81103-1a53-432a-aaa9-816ad6adda94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:57Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faada9-e509-41c0-b3a7-5f58ee1b7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faada9-e509-41c0-b3a7-5f58ee1b7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa45cc18-d189-4335-a91c-ba464822ea38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa45cc18-d189-4335-a91c-ba464822ea38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb81103-1a53-432a-aaa9-816ad6adda94', 'volume_name': 'volume-6fb81103-1a53-432a-aaa9-816ad6adda94', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a879d28-0832-4873-9927-70f47c21aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a879d28-0832-4873-9927-70f47c21aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c327b9-3b59-46a3-8734-cc9f278d82ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:56 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Volume 6fb81103-1a53-432a-aaa9-816ad6adda94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb81103-1a53-432a-aaa9-816ad6adda94', 'volume_size': 1} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643157789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb81103-1a53-432a-aaa9-816ad6adda94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:32:57Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Creating volume 6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:32:56 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:32:56 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:56 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 1073741824 Sep 28 17:32:56 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:57 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 1073741824" returned: 0 in 0.422s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:57 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 Sep 28 17:32:57 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:57 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c327b9-3b59-46a3-8734-cc9f278d82ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb81103-1a53-432a-aaa9-816ad6adda94', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cd01a2-ae37-4fd1-8c37-51f5f5321e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:32:57 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Volume volume-6fb81103-1a53-432a-aaa9-816ad6adda94 (6fb81103-1a53-432a-aaa9-816ad6adda94): created successfully Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cd01a2-ae37-4fd1-8c37-51f5f5321e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (fc3ad22a-611d-4653-90bb-16836d1a426b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-e4abd127-1409-401b-8e03-e8582d1fd55e-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:57 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a8f61b36-6662-46a2-a9ce-04f677d29bf6 tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-e4abd127-1409-401b-8e03-e8582d1fd55e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-e4abd127-1409-401b-8e03-e8582d1fd55e" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-e4abd127-1409-401b-8e03-e8582d1fd55e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Deleting offline snapshot e4abd127-1409-401b-8e03-e8582d1fd55e of volume ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] snapshot_file for this snap is: volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c97501-6640-4ced-9b44-4e3d66247338]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:57 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:57 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e Sep 28 17:32:57 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot aabca8ad-6448-400b-a75e-6dd3a3b68312 of volume 6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256b3e8-b470-4c83-a040-c0778f7e2ed7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:58 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 Sep 28 17:32:58 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:58 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e" returned: 0 in 0.430s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab2c5d79-3def-46e3-8339-e4721e64a57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4653f5a5-267c-4cc0-b1cf-3ca730b21193]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:58 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e Sep 28 17:32:58 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:58 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94" returned: 0 in 0.400s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:58 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 1G Sep 28 17:32:58 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:58 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e" returned: 0 in 0.405s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:58 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e Sep 28 17:32:58 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:58 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 1G" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:58 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fb81103-1a53-432a-aaa9-816ad6adda94 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:58 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fb81103-1a53-432a-aaa9-816ad6adda94 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 Sep 28 17:32:58 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:59 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e" returned: 0 in 0.413s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:59 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e Sep 28 17:32:59 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:59 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fb81103-1a53-432a-aaa9-816ad6adda94 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312" returned: 0 in 0.323s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:59 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 is being set with open permissions: ugo+rw Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:59 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 Sep 28 17:32:59 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:59 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e.e4abd127-1409-401b-8e03-e8582d1fd55e" returned: 0 in 0.279s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-e4abd127-1409-401b-8e03-e8582d1fd55e" released by "_delete_snapshot" :: held 1.650s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" released by "delete_snapshot" :: held 1.674s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Created reservations ['2579f564-aeb3-46b4-b49b-b2cf0009302e', '7c759d95-6c25-4f30-8587-dac894c60ea3', '60b69cae-fc81-4787-be8b-a776e3e50f87', 'bd488047-561f-478b-a702-dedf58dd318f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:32:59 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312" returned: 0 in 0.288s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:59 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Delete snapshot completed successfully. Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b7e3bd99-0cd8-461e-8de9-e10db7fa346e tempest-ProjectReaderTests-744252029 None] Lock "cinder-e4abd127-1409-401b-8e03-e8582d1fd55e-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:32:59 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info Sep 28 17:32:59 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:59 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info" returned: 0 in 0.265s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:32:59 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info is being set with open permissions: ugo+rw Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:32:59 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info Sep 28 17:32:59 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-ab2c5d79-3def-46e3-8339-e4721e64a57e-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "cinder-ab2c5d79-3def-46e3-8339-e4721e64a57e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Acquiring lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:32:59 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" acquired by "delete_volume" :: waited 0.015s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35664b-23a2-4c82-ac8f-0e48ff77d594]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:00 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.info" returned: 0 in 0.281s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:00 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e Sep 28 17:33:00 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:00 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-6f42d550-e5b1-4c1c-a4f3-23448b9c92b6 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:33:00 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e" returned: 0 in 0.383s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:00 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e Sep 28 17:33:00 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:00 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-ab2c5d79-3def-46e3-8339-e4721e64a57e" returned: 0 in 0.250s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "cinder-quobyte-ab2c5d79-3def-46e3-8339-e4721e64a57e" released by "delete_volume" :: held 0.714s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Created reservations ['32dbec3e-c279-401e-929d-7f5d32dee86f', 'c03e3dd4-a1a4-41cf-864a-accacc632449', 'fa639b9c-a5fc-47a8-8a02-26611427f007', '4d141a22-a692-417f-8831-c60b461e18ad'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:00 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:00 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:00 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:01 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:01 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Deleted volume successfully. Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c426b8c4-a063-401f-9066-254a664d578b tempest-ProjectReaderTests-744252029 None] Lock "cinder-ab2c5d79-3def-46e3-8339-e4721e64a57e-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-aabca8ad-6448-400b-a75e-6dd3a3b68312-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aabca8ad-6448-400b-a75e-6dd3a3b68312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-aabca8ad-6448-400b-a75e-6dd3a3b68312" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aabca8ad-6448-400b-a75e-6dd3a3b68312" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot aabca8ad-6448-400b-a75e-6dd3a3b68312 of volume 6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72f1f9b-c094-4f57-97d0-b95bffb72192]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:01 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 Sep 28 17:33:01 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:01 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312" returned: 0 in 0.394s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fb81103-1a53-432a-aaa9-816ad6adda94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9b261b-f730-4b64-84b8-d30eaaf3e0f5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:01 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:01 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 Sep 28 17:33:01 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:02 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94" returned: 0 in 0.417s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:02 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 Sep 28 17:33:02 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:02 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312" returned: 0 in 0.423s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:02 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312 Sep 28 17:33:02 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:02 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94.aabca8ad-6448-400b-a75e-6dd3a3b68312" returned: 0 in 0.307s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aabca8ad-6448-400b-a75e-6dd3a3b68312" released by "_delete_snapshot" :: held 1.665s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:02 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" released by "delete_snapshot" :: held 1.692s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Created reservations ['9e6bebbb-8b82-4eed-ade8-91fa5c01fe13', '4e221e79-9582-489b-ba1c-cc2eaf28b837', '50594039-5dce-4277-9d53-d82025e27dbb', '526253b7-d710-4445-aa4a-d04f1079a102'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:03 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-8e1f9b72-09a8-4700-8c70-9cb67747e921 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aabca8ad-6448-400b-a75e-6dd3a3b68312-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-6fb81103-1a53-432a-aaa9-816ad6adda94-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "cinder-6fb81103-1a53-432a-aaa9-816ad6adda94-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e4cbc-762b-443c-aee3-bcc9c107060c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:03 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 Sep 28 17:33:03 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:03 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94" returned: 0 in 0.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:03 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:04 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94 Sep 28 17:33:04 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:04 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-6fb81103-1a53-432a-aaa9-816ad6adda94" returned: 0 in 0.265s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-6fb81103-1a53-432a-aaa9-816ad6adda94" released by "delete_volume" :: held 0.734s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Created reservations ['4a5dcaf8-c9e4-48fa-8217-3551ea69190f', '6d3e019c-3741-41f3-a876-3d32e1b4a498', 'cb55ae1b-1da8-49b7-90cd-3b7781193d47', '4b1dbbd4-fd0f-46c5-9ab3-0bd9c1bfc95d'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:04 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:04 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:04 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.273s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:04 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:33:04 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-464e109b-3af3-4ba1-a77a-1ab30ada390f tempest-ProjectMemberTests-1556191539 None] Lock "cinder-6fb81103-1a53-432a-aaa9-816ad6adda94-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (9f224f8b-0dc0-4e24-b64d-97e001fba33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e59287-b357-4ef7-902c-5573a11a8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e59287-b357-4ef7-902c-5573a11a8209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468631335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a5284-a3d4-4fab-b091-bb6e48665863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:05Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e72ea9f-ad87-4bff-89cf-b426b0030bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e72ea9f-ad87-4bff-89cf-b426b0030bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8290bad2-f4e2-4f2b-980b-8c891cab37f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8290bad2-f4e2-4f2b-980b-8c891cab37f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57a5284-a3d4-4fab-b091-bb6e48665863', 'volume_name': 'volume-a57a5284-a3d4-4fab-b091-bb6e48665863', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfa2bfe-930d-4228-8191-ea39ea43b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfa2bfe-930d-4228-8191-ea39ea43b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf6d59c-12ed-44ca-a2ef-18723fa081f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Volume a57a5284-a3d4-4fab-b091-bb6e48665863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57a5284-a3d4-4fab-b091-bb6e48665863', 'volume_size': 1} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1468631335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57a5284-a3d4-4fab-b091-bb6e48665863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:05Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Creating volume a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:05 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:05 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 1073741824 Sep 28 17:33:05 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:05 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 1073741824" returned: 0 in 0.419s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:05 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 Sep 28 17:33:05 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:05 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863" returned: 0 in 0.275s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf6d59c-12ed-44ca-a2ef-18723fa081f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57a5284-a3d4-4fab-b091-bb6e48665863', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166d573e-c64f-49a4-8c83-39c5788267e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:05 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Volume volume-a57a5284-a3d4-4fab-b091-bb6e48665863 (a57a5284-a3d4-4fab-b091-bb6e48665863): created successfully Sep 28 17:33:05 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166d573e-c64f-49a4-8c83-39c5788267e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (9f224f8b-0dc0-4e24-b64d-97e001fba33d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:06 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-98845a41-4bf8-47bf-9a1d-8f01a5448cae tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot e28c81c5-3479-459c-97a0-411e8148131e of volume a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f7d47-a037-4107-ab4c-30c2f42e8026]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:06 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 Sep 28 17:33:06 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:06 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863" returned: 0 in 0.414s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:06 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:06 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e 1G Sep 28 17:33:06 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:07 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e 1G" returned: 0 in 0.434s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57a5284-a3d4-4fab-b091-bb6e48665863 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:07 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57a5284-a3d4-4fab-b091-bb6e48665863 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e Sep 28 17:33:07 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:07 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a57a5284-a3d4-4fab-b091-bb6e48665863 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e" returned: 0 in 0.312s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:07 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e is being set with open permissions: ugo+rw Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:07 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:07 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:07 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e Sep 28 17:33:07 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:07 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:33:07 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:07 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info Sep 28 17:33:07 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:08 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:08 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info is being set with open permissions: ugo+rw Sep 28 17:33:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:08 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info Sep 28 17:33:08 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:08 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.info" returned: 0 in 0.248s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:08 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:08 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-f7cb6bc7-d57a-4ae7-a4f5-3fc422f3e881 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-e28c81c5-3479-459c-97a0-411e8148131e-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e28c81c5-3479-459c-97a0-411e8148131e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-e28c81c5-3479-459c-97a0-411e8148131e" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e28c81c5-3479-459c-97a0-411e8148131e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot e28c81c5-3479-459c-97a0-411e8148131e of volume a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6729bc11-46f2-4e4b-90ca-43f08e6691a9]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:09 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:10 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e Sep 28 17:33:10 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:10 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a57a5284-a3d4-4fab-b091-bb6e48665863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bf41f1-0c7b-4cc3-9c64-ff3e29a56adf]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:10 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 Sep 28 17:33:10 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:10 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863" returned: 0 in 0.380s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:10 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:10 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e Sep 28 17:33:10 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:11 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e" returned: 0 in 0.356s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:11 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e Sep 28 17:33:11 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:11 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863.e28c81c5-3479-459c-97a0-411e8148131e" returned: 0 in 0.255s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e28c81c5-3479-459c-97a0-411e8148131e" released by "_delete_snapshot" :: held 1.469s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" released by "delete_snapshot" :: held 1.494s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:11 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Created reservations ['d07cc278-0be9-44be-963b-e6cac6a9cd31', '1a70ded0-118f-4db9-84eb-56969bbb9558', '847de3cb-a83a-4f15-88a6-15f27d0d418c', '8424a5dd-8664-4004-a0e1-7959e628092a'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-a57a5284-a3d4-4fab-b091-bb6e48665863-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "cinder-a57a5284-a3d4-4fab-b091-bb6e48665863-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:12 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-982f42fd-0ece-4165-937a-1b52434d3434 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e28c81c5-3479-459c-97a0-411e8148131e-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" acquired by "delete_volume" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[276952f2-dca6-4c3f-ac5f-edb935252c72]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:12 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 Sep 28 17:33:12 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:12 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863" returned: 0 in 0.376s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:12 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:12 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863 Sep 28 17:33:12 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:13 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-a57a5284-a3d4-4fab-b091-bb6e48665863" returned: 0 in 0.253s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-a57a5284-a3d4-4fab-b091-bb6e48665863" released by "delete_volume" :: held 0.703s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Created reservations ['b7449f20-8ded-4faf-b501-ccb7ab7660d4', 'ddac1674-1bc4-4922-bf51-7a1ffb9847be', '26b3049e-d041-4362-936b-eb7f28564f5d', 'ccc5f6b8-1455-47fa-9805-4dd5cb183737'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:13 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:13 devstack sudo[110076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:13 devstack sudo[110076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:14 devstack sudo[110076]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:14 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.269s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:14 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:14 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:33:14 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-40a10981-7006-4567-a0e6-f1ad00f45dac tempest-ProjectMemberTests-1556191539 None] Lock "cinder-a57a5284-a3d4-4fab-b091-bb6e48665863-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (2a51cacd-4a2b-4786-9060-1e0cd1386e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71543765-5657-4900-99c4-4e0027a3e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71543765-5657-4900-99c4-4e0027a3e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004322444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f67ab-6e9a-4071-afcc-a963ade5d983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:15Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e485c9a-e8c1-4598-811d-7fe723e74609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e485c9a-e8c1-4598-811d-7fe723e74609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67425918-21c5-4ee7-a885-1f8abaf11528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67425918-21c5-4ee7-a885-1f8abaf11528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9f67ab-6e9a-4071-afcc-a963ade5d983', 'volume_name': 'volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c523ce7-160f-460b-9eb6-affe326eb5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c523ce7-160f-460b-9eb6-affe326eb5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941eb251-434d-4383-8e33-942c107e694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:15 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Volume 2e9f67ab-6e9a-4071-afcc-a963ade5d983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983', 'volume_size': 1} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004322444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f67ab-6e9a-4071-afcc-a963ade5d983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:15Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Creating volume 2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:15 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:15 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 1073741824 Sep 28 17:33:15 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:15 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 1073741824" returned: 0 in 0.501s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:15 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 Sep 28 17:33:15 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:15 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983" returned: 0 in 0.260s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:15 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941eb251-434d-4383-8e33-942c107e694a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e45999-e758-4e43-8b5f-a2e134e67f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:16 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Volume volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 (2e9f67ab-6e9a-4071-afcc-a963ade5d983): created successfully Sep 28 17:33:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e45999-e758-4e43-8b5f-a2e134e67f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:16 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (2a51cacd-4a2b-4786-9060-1e0cd1386e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:16 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-544cac10-337b-4673-b496-1a511a4a501f tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot 3d04a1db-277a-4eaa-9855-c6485b9852ed of volume 2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c3f256-8d16-4e37-beba-324bec1dd8e7]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:17 devstack sudo[110089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 Sep 28 17:33:17 devstack sudo[110089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:17 devstack sudo[110089]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983" returned: 0 in 0.381s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:17 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:17 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed 1G Sep 28 17:33:17 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:18 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed 1G" returned: 0 in 0.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:18 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed Sep 28 17:33:18 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:18 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed" returned: 0 in 0.286s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:18 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed is being set with open permissions: ugo+rw Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:18 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed Sep 28 17:33:18 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:18 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed" returned: 0 in 0.258s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:18 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info Sep 28 17:33:18 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:18 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info" returned: 0 in 0.273s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:18 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info is being set with open permissions: ugo+rw Sep 28 17:33:18 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:19 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info Sep 28 17:33:19 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:19 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.info" returned: 0 in 0.278s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:19 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:19 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-93f56e0d-8c08-4e90-98b0-fe1a34e0fbd9 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-3d04a1db-277a-4eaa-9855-c6485b9852ed-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-3d04a1db-277a-4eaa-9855-c6485b9852ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-3d04a1db-277a-4eaa-9855-c6485b9852ed" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3d04a1db-277a-4eaa-9855-c6485b9852ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot 3d04a1db-277a-4eaa-9855-c6485b9852ed of volume 2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c50bf-cc01-4807-ab57-0c3c7c0ed5b8]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:20 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed Sep 28 17:33:20 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:20 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed" returned: 0 in 0.384s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:20 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[069ebc34-a9ba-4bc2-a182-375dfea33884]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:21 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 Sep 28 17:33:21 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:21 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983" returned: 0 in 0.395s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:21 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed Sep 28 17:33:21 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:21 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed" returned: 0 in 0.334s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:21 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed Sep 28 17:33:21 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:21 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:21 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983.3d04a1db-277a-4eaa-9855-c6485b9852ed" returned: 0 in 0.246s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-3d04a1db-277a-4eaa-9855-c6485b9852ed" released by "_delete_snapshot" :: held 1.471s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" released by "delete_snapshot" :: held 1.499s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Created reservations ['1ce3b681-a3cc-4551-89bb-33c86a7827e7', '062c4ca5-b3f3-4d75-8b1c-db9d65eeabf9', 'b2ba324e-a442-4e90-b406-c65b995672ac', 'b8556136-33d2-463e-b234-bd7f30471f50'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:22 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b5e0e8a8-1cdd-47d9-9354-d1635c6f8a2d tempest-ProjectMemberTests-1556191539 None] Lock "cinder-3d04a1db-277a-4eaa-9855-c6485b9852ed-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-2e9f67ab-6e9a-4071-afcc-a963ade5d983-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-2e9f67ab-6e9a-4071-afcc-a963ade5d983-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" acquired by "delete_volume" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc2fde-af45-461d-a8b6-81367d62e541]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:22 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:22 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 Sep 28 17:33:22 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:23 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983" returned: 0 in 0.387s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:23 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983 Sep 28 17:33:23 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:23 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-2e9f67ab-6e9a-4071-afcc-a963ade5d983" returned: 0 in 0.285s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-2e9f67ab-6e9a-4071-afcc-a963ade5d983" released by "delete_volume" :: held 0.754s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Created reservations ['6671eb9e-f1f7-43ff-a849-f1a56314f316', '6a256691-b415-4f7f-8a33-56cace480273', '0fbda170-ab0c-4fe9-97e0-b64d245770f0', '03272aa1-d8c4-4b6d-a710-e72e40f77fe2'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:23 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:23 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:23 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:24 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.289s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:24 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-0f39b9da-8a09-47ca-89cf-282d6d57fad6 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-2e9f67ab-6e9a-4071-afcc-a963ade5d983-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (f96a171e-6907-4878-a159-361177346051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5689286-02c7-46a7-b3b2-26c794334429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5689286-02c7-46a7-b3b2-26c794334429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683716040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:24Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfea30da-cfcc-4fb0-a820-daf15f2ee1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfea30da-cfcc-4fb0-a820-daf15f2ee1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a8fc2-cdb6-4da4-a240-d7355e4fab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a8fc2-cdb6-4da4-a240-d7355e4fab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8', 'volume_name': 'volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9229c5-4dd1-49be-8b81-b1b65dc051a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9229c5-4dd1-49be-8b81-b1b65dc051a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f090fc2c-19d3-478c-9001-bf064b911ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:24 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Volume c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8', 'volume_size': 1} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683716040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:24Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Creating volume c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:24 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:24 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 1073741824 Sep 28 17:33:24 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:24 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 1073741824" returned: 0 in 0.462s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:24 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:25 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 Sep 28 17:33:25 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:25 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" returned: 0 in 0.272s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f090fc2c-19d3-478c-9001-bf064b911ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c6fd9-0f02-4e16-b6bf-82e2717bc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:25 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Volume volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 (c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8): created successfully Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7c6fd9-0f02-4e16-b6bf-82e2717bc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:25 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (f96a171e-6907-4878-a159-361177346051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:25 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-a9292859-26f7-49dd-a8c8-9ea03e9bde53 tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:33:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:26 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot e27e75e8-f7e1-4d70-a149-f56d5d9282a4 of volume c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:33:26 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01fc1ad-c690-42d7-9c20-b53a00507199]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:26 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:26 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 Sep 28 17:33:26 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:27 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:27 devstack sudo[110159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 1G Sep 28 17:33:27 devstack sudo[110159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:27 devstack sudo[110159]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 1G" returned: 0 in 0.483s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:27 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 Sep 28 17:33:27 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:27 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4" returned: 0 in 0.339s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:27 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 is being set with open permissions: ugo+rw Sep 28 17:33:27 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:28 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 Sep 28 17:33:28 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:28 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:28 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info Sep 28 17:33:28 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:28 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:28 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info is being set with open permissions: ugo+rw Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:28 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info Sep 28 17:33:28 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:28 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.info" returned: 0 in 0.265s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:28 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:28 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-25fa72af-60c5-40aa-908b-2385f4a7815a tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-e27e75e8-f7e1-4d70-a149-f56d5d9282a4-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e27e75e8-f7e1-4d70-a149-f56d5d9282a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-e27e75e8-f7e1-4d70-a149-f56d5d9282a4" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e27e75e8-f7e1-4d70-a149-f56d5d9282a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot e27e75e8-f7e1-4d70-a149-f56d5d9282a4 of volume c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b91ac-2c79-4d17-9a5f-41dbe0d1ae68]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:29 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:30 devstack sudo[110180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 Sep 28 17:33:30 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:30 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4" returned: 0 in 0.401s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2caecbe-6d11-4b95-bb7d-8294f152f8a5]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:30 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 Sep 28 17:33:30 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:30 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" returned: 0 in 0.438s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:30 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:30 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 Sep 28 17:33:30 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:31 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4" returned: 0 in 0.361s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:31 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4 Sep 28 17:33:31 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:31 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8.e27e75e8-f7e1-4d70-a149-f56d5d9282a4" returned: 0 in 0.275s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-e27e75e8-f7e1-4d70-a149-f56d5d9282a4" released by "_delete_snapshot" :: held 1.608s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" released by "delete_snapshot" :: held 1.635s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Created reservations ['23eac2a6-b7e9-467f-b931-55b08301d665', '52f9a619-d145-4285-9dea-3100b6f7eca4', '954abee7-fa95-46a1-9b15-dadbbb2f17d3', '37c2230d-82c9-4686-afdc-c60f037279ce'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:31 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:33:31 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-5877278e-47a6-4795-b7ea-0c5fce454083 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-e27e75e8-f7e1-4d70-a149-f56d5d9282a4-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (39ccd41d-843a-44c6-bb97-cea615d2c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d784eb-7753-471d-b458-a950a0e5a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d784eb-7753-471d-b458-a950a0e5a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380407177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a5c5b1-728d-4c71-bd68-b4b1b88f28e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:32Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46370db5-1cda-4722-889e-7c572d97dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46370db5-1cda-4722-889e-7c572d97dda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856f5317-9ab4-4805-b19e-576d4e455f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856f5317-9ab4-4805-b19e-576d4e455f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a5c5b1-728d-4c71-bd68-b4b1b88f28e1', 'volume_name': 'volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157694c-6214-4833-81df-ff8fef346bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157694c-6214-4833-81df-ff8fef346bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5db418-777b-4bc5-b274-e87ff3279a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Volume 41a5c5b1-728d-4c71-bd68-b4b1b88f28e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1', 'volume_size': 1} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380407177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a5c5b1-728d-4c71-bd68-b4b1b88f28e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:32Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Creating volume 41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:32 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" acquired by "delete_volume" :: waited 0.079s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:32 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 1073741824 Sep 28 17:33:32 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2b39f-2f09-47a9-ad4d-4c073537cc2c]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:32 devstack sudo[110200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 Sep 28 17:33:32 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:32 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 1073741824" returned: 0 in 0.458s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:32 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" returned: 0 in 0.425s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:32 devstack sudo[110208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 Sep 28 17:33:32 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:32 devstack sudo[110209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8 Sep 28 17:33:32 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:32 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" returned: 0 in 0.271s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:32 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" returned: 0 in 0.263s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5db418-777b-4bc5-b274-e87ff3279a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be05d262-8d67-4f25-b5d2-e94cdb9659b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:32 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8" released by "delete_volume" :: held 0.776s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Volume volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 (41a5c5b1-728d-4c71-bd68-b4b1b88f28e1): created successfully Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be05d262-8d67-4f25-b5d2-e94cdb9659b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (39ccd41d-843a-44c6-bb97-cea615d2c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-1e918ddc-510e-4601-b64d-a4d696b41dd6 tempest-ProjectReaderTests-1821287382 None] Created volume successfully. Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Created reservations ['0946cc00-5da0-477e-b49d-3ab7fda2b763', 'fe978791-2fda-4237-9e37-997c452da499', '2ffa7fdc-8ef1-4c6b-a8b3-2bf0f006817d', 'd4080c1f-d580-4408-bd33-75e7bb89e89f'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:33 devstack sudo[110214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:33 devstack sudo[110214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:33 devstack sudo[110214]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.257s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:33 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-4bcd2c58-0137-4429-a855-34febd18cd84 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-c8ae0344-fb61-41e9-ad44-5b25b8cc5fb8-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (1b1347f1-775e-4848-b716-96aedeeb4f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809e2ae8-83dd-4791-a2eb-e2935d57aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809e2ae8-83dd-4791-a2eb-e2935d57aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514678268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ccbdd-37c3-4b7e-a565-a3e096910aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:34Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fb637d-e9b8-44f2-b807-ad42f772b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fb637d-e9b8-44f2-b807-ad42f772b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58f4d5d-b301-4527-835a-a9c466eb9682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58f4d5d-b301-4527-835a-a9c466eb9682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2ccbdd-37c3-4b7e-a565-a3e096910aa0', 'volume_name': 'volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f665ee11-105f-45f6-b270-eecfe38e1bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f665ee11-105f-45f6-b270-eecfe38e1bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458e698-1bcd-42d3-8b97-d48046025fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:33 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Volume aa2ccbdd-37c3-4b7e-a565-a3e096910aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0', 'volume_size': 1} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514678268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ccbdd-37c3-4b7e-a565-a3e096910aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5bc19f3c304ba894aa01e8eefcac75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:34Z,use_quota=True,user_id='1c1e700899ae4a37b2b5d24c5130f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Creating volume aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:33 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:33 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:33 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 1073741824 Sep 28 17:33:33 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:34 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 1073741824" returned: 0 in 0.457s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:34 devstack sudo[110223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 Sep 28 17:33:34 devstack sudo[110223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "cinder-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-quobyte-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[780da350-5d75-4700-b127-939562b99d89]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:34 devstack sudo[110223]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" returned: 0 in 0.300s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:34 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 Sep 28 17:33:34 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d458e698-1bcd-42d3-8b97-d48046025fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf2d06-8b4d-4f6a-a545-2b133c0f3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:34 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Volume volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 (aa2ccbdd-37c3-4b7e-a565-a3e096910aa0): created successfully Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9caf2d06-8b4d-4f6a-a545-2b133c0f3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Flow 'volume_create_manager' (1b1347f1-775e-4848-b716-96aedeeb4f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:34 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c4f7f4a2-714a-4e18-a425-44f5c7bf40f6 tempest-ProjectMemberTests-1556191539 None] Created volume successfully. Sep 28 17:33:34 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" returned: 0 in 0.384s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:34 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:34 devstack sudo[110231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1 Sep 28 17:33:34 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:35 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" returned: 0 in 0.254s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1" released by "delete_volume" :: held 0.691s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Created reservations ['1cf3266c-dfd3-4edb-88dc-edd72c629e9b', 'd8e4b8c5-d33c-4633-98a3-96318e0c1ccd', '59198d6a-34e3-4db2-9e09-3863c91bf664', '45729291-a14c-49dd-8eee-82d4b7064b9c'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:35 devstack sudo[110234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:35 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:35 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.259s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:35 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Deleted volume successfully. Sep 28 17:33:35 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-c8063985-e386-410e-bf5a-540713948e7b tempest-ProjectReaderTests-1821287382 None] Lock "cinder-41a5c5b1-728d-4c71-bd68-b4b1b88f28e1-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Creating offline snapshot aa9ebcfa-e83c-497d-82de-91c696491551 of volume aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (002042ad-1d1e-4c62-9d37-705fcaef0452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f65245-6af6-47c6-a55e-ffd48a25c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7c4cb-a04f-4302-a684-518afcb8e307]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f65245-6af6-47c6-a55e-ffd48a25c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812158742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeefd00e-b23c-4392-9ef7-ff940d022dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:36Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2213c1-c907-4dc3-8ced-660dc1b6d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2213c1-c907-4dc3-8ced-660dc1b6d469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde370e3-d140-44a2-8b41-160b2fd630ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde370e3-d140-44a2-8b41-160b2fd630ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeefd00e-b23c-4392-9ef7-ff940d022dad', 'volume_name': 'volume-aeefd00e-b23c-4392-9ef7-ff940d022dad', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aa44fa-1e20-4588-a907-8f906c043608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3aa44fa-1e20-4588-a907-8f906c043608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493bbc5f-b63d-455d-aa57-eb1d80a0c9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:36 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Volume aeefd00e-b23c-4392-9ef7-ff940d022dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeefd00e-b23c-4392-9ef7-ff940d022dad', 'volume_size': 1} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:36 devstack sudo[110237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 Sep 28 17:33:36 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:36 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" returned: 0 in 0.381s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:36 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 1G {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:36 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 1G Sep 28 17:33:36 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:37 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 1G" returned: 0 in 0.415s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:37 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 Sep 28 17:33:37 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:37 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 -F qcow2 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551" returned: 0 in 0.295s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:37 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 is being set with open permissions: ugo+rw Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:37 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 Sep 28 17:33:37 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:37 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551" returned: 0 in 0.254s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:37 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info Sep 28 17:33:37 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:37 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info" returned: 0 in 0.251s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:37 devstack cinder-volume[86929]: WARNING cinder.volume.drivers.remotefs [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info is being set with open permissions: ugo+rw Sep 28 17:33:37 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:37 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info Sep 28 17:33:37 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:38 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.info" returned: 0 in 0.255s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812158742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeefd00e-b23c-4392-9ef7-ff940d022dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:36Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Creating volume aeefd00e-b23c-4392-9ef7-ff940d022dad {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:38 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:38 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad 1073741824 Sep 28 17:33:38 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-61fc34dd-17a0-4da9-9d85-4137935080d3 tempest-ProjectMemberTests-1556191539 None] Create snapshot completed successfully Sep 28 17:33:38 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad 1073741824" returned: 0 in 0.424s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:38 devstack sudo[110268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad Sep 28 17:33:38 devstack sudo[110268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:38 devstack sudo[110268]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad" returned: 0 in 0.257s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493bbc5f-b63d-455d-aa57-eb1d80a0c9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeefd00e-b23c-4392-9ef7-ff940d022dad', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8170275-6959-43cb-b816-8f4475724bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:38 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Volume volume-aeefd00e-b23c-4392-9ef7-ff940d022dad (aeefd00e-b23c-4392-9ef7-ff940d022dad): created successfully Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8170275-6959-43cb-b816-8f4475724bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:38 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (002042ad-1d1e-4c62-9d37-705fcaef0452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:38 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-24570228-5bd4-4318-b110-d66db141d60b tempest-ProjectReaderTests-1821287382 None] Created volume successfully. Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-aeefd00e-b23c-4392-9ef7-ff940d022dad-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-aeefd00e-b23c-4392-9ef7-ff940d022dad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-quobyte-aeefd00e-b23c-4392-9ef7-ff940d022dad" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-aeefd00e-b23c-4392-9ef7-ff940d022dad" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b2f2c-47de-4437-8e7e-37c6b545d5b2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-aa9ebcfa-e83c-497d-82de-91c696491551-delete_snapshot" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aa9ebcfa-e83c-497d-82de-91c696491551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" by "delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-aa9ebcfa-e83c-497d-82de-91c696491551" by "_delete_snapshot" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa9ebcfa-e83c-497d-82de-91c696491551" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Deleting offline snapshot aa9ebcfa-e83c-497d-82de-91c696491551 of volume aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] snapshot_file for this snap is: volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc08b4c3-4120-4195-ac05-7e13a0865113]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:39 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad Sep 28 17:33:39 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:39 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 Sep 28 17:33:39 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:39 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad" returned: 0 in 0.409s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:39 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad Sep 28 17:33:39 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:39 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551" returned: 0 in 0.389s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86929) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ea938-d84f-42ef-a52c-878476b6a5c2]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:39 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:40 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 Sep 28 17:33:40 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:40 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aeefd00e-b23c-4392-9ef7-ff940d022dad" returned: 0 in 0.262s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-aeefd00e-b23c-4392-9ef7-ff940d022dad" released by "delete_volume" :: held 0.727s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Created reservations ['c8765267-a0f4-4a2f-9511-6cc866c337bb', 'c48867a7-742e-4dc7-98ac-8f215cbc3a7b', 'ee57c7c9-11d6-4468-8a75-9591eebde038', '447b1fc9-1416-49d5-9529-b2f834d9c1c6'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:40 devstack sudo[110287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:40 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:40 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" returned: 0 in 0.396s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:40 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 Sep 28 17:33:40 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:40 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.296s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:40 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Deleted volume successfully. Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-b1517c87-184b-4cf3-9c69-26ea3e199b38 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-aeefd00e-b23c-4392-9ef7-ff940d022dad-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:40 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551" returned: 0 in 0.385s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:40 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551 Sep 28 17:33:40 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (eedea76f-0909-4c88-811d-6aec150a732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2328889-998a-41b9-bb2a-e15ddf6e360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:40 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:40 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2328889-998a-41b9-bb2a-e15ddf6e360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767338320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5f2d1-3e2f-446d-9392-37eb64771229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:41Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edede1e-9b99-4a64-b988-dd4d9911c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edede1e-9b99-4a64-b988-dd4d9911c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63962ac3-3239-4233-b802-dd5c25570e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63962ac3-3239-4233-b802-dd5c25570e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a5f2d1-3e2f-446d-9392-37eb64771229', 'volume_name': 'volume-b4a5f2d1-3e2f-446d-9392-37eb64771229', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66585c42-85df-4f5a-930a-11850a508489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66585c42-85df-4f5a-930a-11850a508489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bbb5bf-694e-4f31-b39a-d2bead40b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Volume b4a5f2d1-3e2f-446d-9392-37eb64771229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a5f2d1-3e2f-446d-9392-37eb64771229', 'volume_size': 1} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-767338320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5f2d1-3e2f-446d-9392-37eb64771229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:41Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Creating volume b4a5f2d1-3e2f-446d-9392-37eb64771229 {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:41 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0.aa9ebcfa-e83c-497d-82de-91c696491551" returned: 0 in 0.352s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:41 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 1073741824 Sep 28 17:33:41 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa9ebcfa-e83c-497d-82de-91c696491551" released by "_delete_snapshot" :: held 1.629s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" released by "delete_snapshot" :: held 1.661s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Created reservations ['378b3a61-d457-4e34-9d12-aac6ef934bca', '18f79bd8-c44e-4c98-b908-c70915813e1f', '84c8c395-8e5b-4453-9c95-6cca0ad7670b', 'b272b548-0bf6-47dc-98cc-ce57e188eaeb'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Delete snapshot completed successfully. Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-e7311ba4-a09c-469c-ae2a-d39d015017a2 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aa9ebcfa-e83c-497d-82de-91c696491551-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:41 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 1073741824" returned: 0 in 0.446s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:41 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 Sep 28 17:33:41 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[184c10b5-0d48-4dc0-958b-3fc65715c82b]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:41 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229" returned: 0 in 0.284s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:41 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82bbb5bf-694e-4f31-b39a-d2bead40b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a5f2d1-3e2f-446d-9392-37eb64771229', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec42271a-aeba-4280-a622-8531b7ecae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:41 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Volume volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 (b4a5f2d1-3e2f-446d-9392-37eb64771229): created successfully Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec42271a-aeba-4280-a622-8531b7ecae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:41 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (eedea76f-0909-4c88-811d-6aec150a732a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:41 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-db139bc6-96c8-450a-8255-2f73d680c487 tempest-ProjectReaderTests-1821287382 None] Created volume successfully. Sep 28 17:33:42 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" returned: 0 in 0.369s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:42 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0 Sep 28 17:33:42 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:42 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" returned: 0 in 0.252s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-quobyte-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0" released by "delete_volume" :: held 0.682s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Created reservations ['d7af27cb-6f08-4b0c-894f-32b582a2446b', 'e7875533-1a06-4114-9d1e-13cc740933ca', '8086dcaa-003f-48a4-b357-a36794a7adc5', '651f073e-ad4a-45e1-a6f0-824e25509296'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:42 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:42 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:42 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.280s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:42 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Deleted volume successfully. Sep 28 17:33:42 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-108e2ad4-660c-497d-922c-12d56f9e64e5 tempest-ProjectMemberTests-1556191539 None] Lock "cinder-aa2ccbdd-37c3-4b7e-a565-a3e096910aa0-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-b4a5f2d1-3e2f-446d-9392-37eb64771229-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "cinder-b4a5f2d1-3e2f-446d-9392-37eb64771229-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-quobyte-b4a5f2d1-3e2f-446d-9392-37eb64771229" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-b4a5f2d1-3e2f-446d-9392-37eb64771229" acquired by "delete_volume" :: waited 0.021s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aed152-dfaf-4973-b7dd-53021fb2ebdf]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:43 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 Sep 28 17:33:43 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:43 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229" returned: 0 in 0.397s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:43 devstack sudo[110333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229 Sep 28 17:33:43 devstack sudo[110333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:43 devstack sudo[110333]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-b4a5f2d1-3e2f-446d-9392-37eb64771229" returned: 0 in 0.279s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-b4a5f2d1-3e2f-446d-9392-37eb64771229" released by "delete_volume" :: held 0.733s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:43 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Created reservations ['479bcb39-f8ad-4674-b46a-590ef75c8a2d', 'fff18db1-54e8-41a4-95ae-604ecd64c445', '90cc5067-6540-440c-b2aa-2d02bfd1039b', '07dd40d3-72ac-496e-9545-fa3e04fe4f4b'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:44 devstack sudo[110336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:44 devstack sudo[110336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:44 devstack sudo[110336]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.282s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:44 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Deleted volume successfully. Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-67f39d1e-1b50-412f-9319-e033b23eacaa tempest-ProjectReaderTests-1821287382 None] Lock "cinder-b4a5f2d1-3e2f-446d-9392-37eb64771229-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86929) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (616658e9-d3df-4520-ada4-244f976e6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44774e9a-6ae3-4f99-90f8-7d7d860a9cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44774e9a-6ae3-4f99-90f8-7d7d860a9cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945740925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c0c7d-1650-483e-ba35-b88c8bad056a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:45Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8b257-a2ac-4a26-b1a5-c528301c17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8b257-a2ac-4a26-b1a5-c528301c17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d57dbc-7bc5-4ef8-88a2-cd1b41ff32cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:44 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d57dbc-7bc5-4ef8-88a2-cd1b41ff32cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08c0c7d-1650-483e-ba35-b88c8bad056a', 'volume_name': 'volume-c08c0c7d-1650-483e-ba35-b88c8bad056a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0b54f-a4f5-445d-8da5-72fd971f11c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0b54f-a4f5-445d-8da5-72fd971f11c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9741cb0-db67-4b88-aca8-1bd9535a8ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Volume c08c0c7d-1650-483e-ba35-b88c8bad056a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08c0c7d-1650-483e-ba35-b88c8bad056a', 'volume_size': 1} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945740925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08c0c7d-1650-483e-ba35-b88c8bad056a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d998a4d7cd4557876bb1644f05229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:33:45Z,use_quota=True,user_id='35ba4818a0f5483aa2902111a3f31d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5232b5d2-8d1b-4add-bc1b-910487516255),volume_type_id=5232b5d2-8d1b-4add-bc1b-910487516255)}" {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.remotefs [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Creating volume c08c0c7d-1650-483e-ba35-b88c8bad056a {{(pid=86929) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Selected osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e as target Quobyte volume. {{(pid=86929) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:33:45 devstack cinder-volume[86929]: INFO cinder.volume.drivers.remotefs [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] casted to osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a 1073741824 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:45 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a 1073741824 Sep 28 17:33:45 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:45 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a 1073741824" returned: 0 in 0.500s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:45 devstack sudo[110345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a Sep 28 17:33:45 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:45 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a" returned: 0 in 0.276s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'} {{(pid=86929) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9741cb0-db67-4b88-aca8-1bd9535a8ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08c0c7d-1650-483e-ba35-b88c8bad056a', 'volume_size': 1}' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39c526e-c93d-4397-87e4-a51c3ed7085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:33:45 devstack cinder-volume[86929]: INFO cinder.volume.flows.manager.create_volume [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Volume volume-c08c0c7d-1650-483e-ba35-b88c8bad056a (c08c0c7d-1650-483e-ba35-b88c8bad056a): created successfully Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39c526e-c93d-4397-87e4-a51c3ed7085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86929) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:33:45 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Flow 'volume_create_manager' (616658e9-d3df-4520-ada4-244f976e6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86929) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:33:45 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-0bb6d446-73d4-45c0-b9cf-c35741cd2e79 tempest-ProjectReaderTests-1821287382 None] Created volume successfully. Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-c08c0c7d-1650-483e-ba35-b88c8bad056a-delete_volume" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-c08c0c7d-1650-483e-ba35-b88c8bad056a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "cinder-quobyte-c08c0c7d-1650-483e-ba35-b88c8bad056a" by "delete_volume" {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-c08c0c7d-1650-483e-ba35-b88c8bad056a" acquired by "delete_volume" :: waited 0.020s {{(pid=86929) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG oslo.privsep.daemon [-] privsep: reply[085a33b7-4b13-4fab-9409-805a2d03ceea]: (4, 'qcow2') {{(pid=88620) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:47 devstack sudo[110349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a Sep 28 17:33:47 devstack sudo[110349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:47 devstack sudo[110349]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a" returned: 0 in 0.404s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:47 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a Sep 28 17:33:47 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:47 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6/volume-c08c0c7d-1650-483e-ba35-b88c8bad056a" returned: 0 in 0.283s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-quobyte-c08c0c7d-1650-483e-ba35-b88c8bad056a" released by "delete_volume" :: held 0.749s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:47 devstack cinder-volume[86929]: DEBUG cinder.quota [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Created reservations ['6cd58b89-5028-4d70-8320-cd1e4a4588fe', 'a0ecf1df-9f5c-473b-8bda-c2bae8fa133a', '63d53819-478e-48de-a2cf-fbc3039e4753', '50ab0074-a7ad-49e9-a538-d05bb6eb81f7'] {{(pid=86929) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:33:48 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:33:48 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:33:48 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.296s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:33:48 devstack cinder-volume[86929]: INFO cinder.volume.manager [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Deleted volume successfully. Sep 28 17:33:48 devstack cinder-volume[86929]: DEBUG cinder.coordination [None req-487e10f7-bff6-40c5-affe-342293943da8 tempest-ProjectReaderTests-1821287382 None] Lock "cinder-c08c0c7d-1650-483e-ba35-b88c8bad056a-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86929) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:33:58 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=118,cinder:INSERT=43,cinder:UPDATE=171,cinder:DELETE=6 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:33:58 devstack cinder-volume[86929]: DEBUG dbcounter [-] [86929] Writing DB stats cinder:SELECT=110,cinder:UPDATE=142,cinder:INSERT=40,cinder:DELETE=20 {{(pid=86929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e': None} {{(pid=86929) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG cinder.volume.drivers.quobyte [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9dec5571-9234-4b13-8a8b-c119066d3a7e'] {{(pid=86929) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.lockutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86929) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:34:07 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6 Sep 28 17:34:07 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:34:07 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_concurrency.processutils [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9bb2913e9aa043fb95b362d7e63c9ac6" returned: 0 in 0.242s {{(pid=86929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG cinder.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Notifying Schedulers of capabilities ... {{(pid=86929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG oslo_service.periodic_task [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] Running periodic task VolumeManager._thread_info {{(pid=86929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread count: 28 {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:34:07 devstack cinder-volume[86929]: DEBUG cinder.volume.manager [None req-26e97bba-c445-40b2-a1cd-38a7574d6440 None None] thread info: [<_MainThread(MainThread, started 132138007343232)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}